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PREFACE 


The  task  for  which  this  Part  1  report  is  written  was  initially  intended  to  evaluate 
potential  mesoscale  weather  forecasting  systems  for  support  of  Army  tactical  operations  in 
the  mid-1980s.  The  task  was  to  be  accomplished  in  two  phases,  the  first  of  which  had  the 
following  major  objective:  evaluate  the  gain  in  operational  utility  of  the  most  optimistic, 
but  reasonable,  improvement  that  might  be  expected  in  the  precision  (i.e.,  accuracy  or 
reliability)  of  mesoscale  weather  forecasts  by  1985.  The  second  phase  was  to  consider 
systems  with  lower  levels  of  prediction  precision  as  well  as  acquisition  and  support  costs  of 
alternative  systems. 

However,  following  the  Phase  l  effort,  whose  major  findings  made  cost-capability 
tradeoffs  among  alternative  mesoscale  weather  forecasting  systems  appear  unimportant,  the 
Phase  2  effort  was  redirected  toward  (1)  a  broader  assessment  of  the  effects  of  weather 
information  on  Army  activities  and  (2)  a  reexamination  of  the  Phase  1  findings,  which 
several  interested  people  found  somewhat  surprising. 

The  Phase  2  effort  is  described  in  the  Part  2  report,  entitled  “Opportunities  for 
Increasing  Army  Effectiveness  Through  Improvements  in  Weather  ini  rmation  Systems,” 
which  includes  discussion  of  the  reexamination  of  Phase  1  findings. 


FOREWORD 


This  report  describes  the  Phase  1  effort  to  evaluate  the  gain  in  utility  of  an  improved 
mesoscale  (i.e.,  small  spatial  and  short  temporal  scales)  weather  prediction  capability  to 
support  Army  tactical  operations  in  the  mid-1980s. 

The  report  is  presented  in  briefing  form.  The  introductory  material,  analyses,  findings, 
and  conclusions  are  contained  in  a  series  of  exhibits  to  allow  a  reader  to  quickly  assimilate 
the  essence  of  the  entire  report  or  any  of  its  parts.  For  the  more  careful  reader,  supporting 
details,  important  observations,  and  pertinent  discussions  are  provided  with  the  appropriate 
exhibits;  appendices  contain  additional  information  and  supporting  material.  The  subject  of 
each  section  (group  of  related  exhibits)  of  the  report  is  indicated  in  the  table  of  contents. 


EXECUTIVE  SUMMARY 


The  main  objective  of  this  study  effort  is  to  assess  the  operational  utility  of  the  most 
optimistic,  but  reasonable,  improvement  in  reliability  of  mesoscale  weather  forecasts  pro¬ 
jected  for  the  mid-1980s  for  Army  ground  and  aviation  forces  in  the  European  theater. 
Data  from  recent  (1975-1977)  tests  on  the  verification  of  weather  forecasts  by  the  National 
Weather  Service  and  the  Air  Weather  Service  are  used  to  estimate  the  reliability  of  current 
mesoscale  weather  forecasts. 

The  study  effort,  based  on  well-accepted  assumptions  that  weather  and  weather  fore¬ 
casting  affect  tactical  operations,  is  directed  specially  toward  answering  the  following  ques¬ 
tion:  Can  Army  forces  be  utilized  more  effectively  or  efficiently  in  day-to-day  operations 
given  an  optimistic  projected  improvement  in  weather  information  used  as  inputs  for  tacti¬ 
cal  planning? 

The  data-gathering  investigation  of  Army  operations  involved  many  workshop-type 
discussions  with  a  broad  cross  section  of  Army  officers  with  varied  experience,  education, 
training,  and  rank  at  the  schools  of  most  Army  branches  (Exhibit  20).  The  discussions 
concerned  detailed  descriptions  of  operational  situations  and  information  inputs  relative  to 
factors  considered  in  tactical  decisions  (in  those  situations)  and  with  the  effects  that  various 
levels  of  weather  information  reliability  would  have  in  decision-making  processes. 

The  major  findings  arc  (1)  the  mutual  supporting  nature  of  the  missions  and  objec¬ 
tives  of  lower  command  le.els  (platoon,  company,  and  battalion)  limit  their  flexibility  to 
react  to  weather  forecasts,  and  (2)  for  higher  command  levels  (division  and  corps),  at  which 
battlefield  planning  is  primarily  done,  the  projected  reliability  of  1985  mesoscale  weather 
forecasts  appears  to  be  insufficiently  better  than  the  reliability  of  current  forecasts  to  make 
weather  predictions  a  more  decisive  planning  factor  (Exhibits  26  and  27). 

Thus,  it  is  concluded  that  an  optimistic  mesoscale  weather  forecasting  capability  pro¬ 
jected  for  1985  offers  no  advantages  for  Army  tactical  operations  (Exhibit  28). 
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EXHIBIT  Is  MESOSCALE  WEATHER  FORECASTING 
(MWF)  TASK,  PHASE  1,  OBJECTIVES 

1.  IDENTIFY  PARAMETERS  USEFUL  IN  DESCRIBING  WEATHER 

PREDICTION  PRECISION 

2.  DETERMINE  HIGHEST  PRECISION  MWF  SYSTEM  THAT  APPEARS 

TECHNICALLY  FEASIBLE  FOR  THE  MID-1980S 

3.  IDENTIFY  RELATIONSHIPS  BETWEEN  WEATHER  FORECASTING 

PRECISION  AND  TACTICAL  OPERATIONAL  CAPABILITY, 
AND,  IF  POSSIBLE,  DEVELOP  SOME  MEASURABLE 
INDICATORS 
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EXHIBIT  1 


The  objectives  indicated  are  those  for  the  MWF  Task, 
Phase  I.  A  copy  of  the  task  order,  which  describes  a  two- 
phase  study,  is  contained  in  Appendix  A.  Considerations  of 
less  capable  MWF  systems  and  their  costs  are  deferred  until 
Phase  2,  which  would  be  undertaken  if  the  most  capable  MWF 
system  that  might  be  available  in  the  mid-1980s  would  appear 
to  offer  potential  improvements  for  Army  tactical  operations. 
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EXHIBIT  2:  SCOPE  OF  STUDY 


•  EUROPE  -  1985 

•  GROUND-BASED  FORCES  -  INFANTRY,  ARMOR,  ARTILLERY 

•  ARMY  AVIATION  FORCES 

•  ALL  COMMAND  ECHELONS  UP  THROUGH  CORPS 

•  WEATHER  INFORMATION  AS  INPUTS  FOR  PLANNING  NOT  AS  COMBAT 

INFORMATION  (i.e.,  NOT  FOR  REAL-TIME  USE  FOR  WEAPON 
SYSTEM  OPERATIONS) 

•  ASSUMPTIONS 

1.  WEATHER  AFFECTS  TACTICAL  OPERATIONS 

2.  WEATHER  FORECASTING  AFFECTS  TACTICAL  OPERATIONS 

3.  BETTER  WEATHER  FORECASTING  WILL  NOT  CHANGE 

FORCE  STRUCTURE 

•  ISSUES 

1.  WILL  IMPROVEMENTS  IN  WEATHER  FORECASTING  IMPROVE 

TACTICAL  CAPABILITY  IN  DAY-TO-DAY  OPERATIONS? 

2,  CAN  AVAILABLE  FORCES  BE  UTILIZED  MORE  EFFECTIVELY 

OR  EFFICIENTLY  WITH  PROJECTED  IMPROVEMENTS  IN 
WEATHER  FORECASTING? 
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EXHIBIT  2 


The  study  effort  focuses  on  Army  forces,  ground-based  and 
aviation,  in  a  European  scenario.  Consideration  is  not  given  to 
USAF  or  USN  forces. 

This  study  is  concerned  with  the  predictive  value  of 
weather  information  to  operational  planners  at  all  command  ech¬ 
elons  from  platoon  through  corps,  and  not  for  its  real-time  use 
for  operating  weapon  systems  (e.g.,  crosswind  for  the  tank  gun¬ 
ner  or  upper  winds  for  the  artillery  man).  It  is  recognized 
that  weather  information  for  use  in  current  combat  may  be  as 
important,  or  more  important,  than  its  use  for  weather  forecasts. 

Anyone  even  modestly  familiar  with  recent  wars--World  War 
II,  Korea,  Vietnam--can  identify  numerous  examples  of  the  impact 
of  weather  on  tactical  operations.  Examples  of  the  influence  of 
weather  forecasting  on  tactical  operations  also  exist  but  are 
less  numerous.  One  example  in  the  Korean  War  is  the  timing  of 
Red  Chinese  and  North  Korean  major  attacks  in  front  of  oncoming 
Arctic  cold  fronts,  forcing  United  Nations  Command  (UNC)  counter¬ 
attacks  to  be  conducted  facing  high  winds,  snow  storms,  and  ex¬ 
tremely  cold  temperatures  after  frontal  passage.  Another  example, 
also  in  the  Korean  War,  is  the  habitual  North  Korean  timing  of 
ground  assaults  in  periods  of  poor  flying  weather  to  negate  UNC 
air  superiority.  In  the  Vietnam  War,  North  Vietnamese  forces 
also  often  took  advantage  of  low  ceiling  and  poor  visibility  to 
initiate  ground  attacks  (examples  are  taken  from  Ref.  1).  Sim¬ 
ilarly,  the  German  Army  Ardennes  offensive  in  December  1944  was 
timed  to  coincide  with  a  period  of  poor  flying  weather  because 
of  Allied  air  superiority. 
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While  the  Normandy  invasion  in  June  1944  is  a  memorable 
example  of  the  influence  of  weather  forecasting  on  operational 
planning,  this  study  is  not  concerned  with  the  impact  of  weather 
forecasting  on  such  epic  events  but  on  the  possible  utility  of 
weather  forecasting  for  day-to-day  tactical  planning  and  operations. 

It  is  assumed  that  all-weather  and  limited-weather  systems 
(e.g.,  radar  and  infrared  sensors  and  weapons)  are  developed  and 
procured  for  U.S.  forces  without  considering  specifics  of  times 
and  places  at  which  they  will  be  used.  These  capabilities  are 
acquired  because  of  (1)  the  reasonable  likelihood  of  encountering 
poor  weather  conditions  in  future  combat  situations,  (2)  the  added 
capability  these  systems  provide  even  in  good  weather  situations, 
and  (3)  the  certainty  that  such  systems  provide  enhanced  night¬ 
time  capability.  Thus,  it  is  assumed  that  the  Army  force  struc¬ 
ture  will  not  be  affected  by  potential  improvements  in  weather 
forecasting  capability. 
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EXHIBIT  3:  STUDY  APPROACH 


1.  IDENTIFY  PRIMARY  ENVIRONMENTAL  PARAMETERS  AND  PARAMETERS 
WHICH  DESCRIBE  USEFULNESS  OF  WEATHER  FORECASTS  TO 
OPERATIONAL  COMMANDERS 

2.  ESTIMATE  VALUES  EXPECTED  FOR  THOSE  PARAMETERS  BY  1985, 
GIVEN  THE  MOST  PRECISE  MWF  SYSTEM 

3.  DETERMINE  FROM  DISCUSSIONS  WITH  A  BROAD  CROSS  SECTION 

OF  ARMY  OFFICERS  IN  SEVERAL  BRANCHES  (INFANTRY,  ARTILLERY, 
ARMOR,  AVIATION,  ETC.)  THE  POTENTIAL  INCREASED  OPERATIONAL 
UTILITY  ACCRUING  FROM  THE  1977-T0-1985  WEATHER  FORECASTING 
IMPROVEMENT 
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EXHIBIT  3 


The  first  step  in  the  study  effort  is  to  identify  param¬ 
eters  associated  with  weather  forecasting  and  the  utility  of 
weather  forecasting  information  from  an  operational  commander's 
perspective. 

The  next  step  is  to  characterize  the  precision  of  the 
weather  forecasting  information  in  quantitative  terms  both  for 
1977  and  for  1985  through  discussion  with  technical  personnel 
of  the  meteorological  community  (agencies  of  the  Federal  govern¬ 
ment  and  some  key  universities)  involved  in  research,  develop¬ 
ment,  testing,  and  evaluation  of  weather  forecasting  systems. 

With  the  weather  forecasting  products  characterized  quan¬ 
titatively,  discussions  with  a  large  number  of  Army  officers 
with  varied  backgrounds  and  experiences  are  the  basis  for  iden¬ 
tifying  specific  potential  tactical  advantages  from  the  most 
optimistic  projected  1 977-to-l 985  improvement  in  weather  fore¬ 
casting  and  for  developing  measurable  indicators  of  those  ad¬ 
vantages  . 

Since  operational  situations  are  so  diverse  and  involve 
so  many  variables  and  factors  apparent  only  to  those  who  have 
been  involved  in  actual  and  simulated  combat  environments, 
identification  of  operational  improvements  that  might  accrue 
from  the  projected  MWF  capability  were  sought  from  lengthy 
group  discussions  with  a  large  number  of  Army  officers  with 
wide-ranging  backgrounds  at  several  Army  schools  and  commands. 
Appendix  B  is  a  copy  of  an  ODDR&E  letter  sent  to  the  Army  War 
College  seeking  assistance  for  this  study.  Similar  letters 
were  sent  to,  and  discussions  were  held  at,  the  U.S.  Army 
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Training  and  Doctrine  Command,  Intelligence  Center,  Aviation 
Center,  Armor  School,  Engineer  School,  Infantry  School,  Field 
Artillery  School,  and  Combined  Arms  Combat  Development  Activity. 

Thus,  the  study  approach  is  to  characterize  quantitatively 
the  MWF  capability  for  1977  and  the  best  expected  for  1985,  and 
then  to  obtain  subjective  data  from  operator-users  on  the  opera¬ 
tional  utility  of  the  optimistic  projected  MWF  improvement. 
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II.  IMPORTANT  STUDY  ELEMENTS: 
DEFINITIONS  AND  IDENTIFICATIONS 
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EXHIBIT  4:  DEFINITION  OF  MESOSCALE 
WEATHER  FORECASTING  (MWF) 

•  MWF  IS  PREDICTING  THE  OCCURRENCE  OF  SUB-SYNOPTIC  SCALE 
EVENTS  FOR  A  LOCAL  AREA 

•MWF  IN  THIS  STUDY  IS  AN  INTERMEDIATE-SCALE  (BETWEEN 
MACRO-  AND  MICROSCALE)  FORECASTING  PROCESS  WHICH  IS 
CONCERNED  WITH  ATMOSPHERIC  DYNAMICS  HAVING  A  SPACE 
SCALE  OF  1-200  KM  AND  A  TIME  SCALE  OF  LESS  THAN  24 
HOURS  AND  WHICH  IS  CONCERNED  WITH  THE  EFFECTS  OF 
ELEMENTS,  SUCH  AS  TERRAIN  AND  CUMULUS  CONVECTION, 

WHICH  ARE  NOT  IMPORTANT  TO  LARGER  SCALE  METEOROLOGY 

•  MWF  METHODS  ARE  OF  THREE  TYPES:  PERSISTENCE,  LOCAL 
(SUBJECTIVE),  AND  GUIDANCE  (OBJECTIVE) 


METEOROLOGICAL  SCALES  (approximate) 


TYPE 

SCALE 

SPATIAL 
SCALE,  KM 

TEMPORAL 
SCALE,  HR 

FORECASTING  TECHNIQUE 

MACROSCALE 

>  2000 

>  24 

NUMERICAL  WEATHER  PREDICTION  (NWP) 

MESOSCALE 

(coarse  mesh) 

200-2000 

24 

MESOSCALE  NWP 

MESOSCALE 

(fine  mesh)2 

1-200 

<  24 

PERSISTENCE,  LOCAL  (MAN),  GUIDANCE 

MICROSCALE 

<  1 

1 

PERSISTENCE,  LOCAL 

OF  PRIMARY  CONCERN  IN  THIS  STUDY.  SPATIAL  SCALE  BOUNDARY  BETWEEN 
MESOSCALE  (FINE  MESH)  AND  MICROSCALE  IS  ASSUMED  TO  BE  1  KM.  FESO- 
SCALE  (FINE  MESH)  FORECASTING  TECHNIQUES  ARE  DESCRIBED  IN  DISCUSSION 
ACCOMPANYING  EXHIBIT  15. 
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EXHIBIT  4 


A  variety  of  definitions  appear  in  the  meteorological  com¬ 
munity  for  space  and  time  scales  for  atmospheric  processes  (see 
Refs.  2,  3,  4,  and  5,  which  are  not  consistent  in  some  scaling 
details). 

Two  conceptual  bases  are  used  for  defining  "mesoscale": 

(l)  weather  event  dimensioning  and  (2)  weather  event  predict¬ 
ability.  Spatial  and  temporal  scales  are  utilized  under  each 
concept  with  different  meanings  but  with  similar  ranges  of 
values.  Under  the  dimensioning  basis,  spatial  and  temporal 
scales  mean  the  spatial  size  and  lifespan,  respectively,  of 
the  weather  event-,  under  the  predictability  basis,  spatial  and 
temporal  scales  mean  the  spatial  size  of  the  area  and  length  of 
time,  respectively,  in  which  a  weather  event  is  predicted  to 
occur.  The  contexts  in  which  spatial  and  temporal  scales  are 
considered  in  this  report  will  indicate  that  the  predictability 
basis  is  usually  implied. 

"Mesoscale"  defines  all  intermediate  scales  between  macro¬ 
scale,  whose  lower  space  limit  is  about  2000  km,  and  microscale, 
whose  upper  space  limit  is  1  km  (Ref.  2).  For  this  study  "meso¬ 
scale"  is  considered  to  involve  a  fine-mesh  space  scale  of  1  to 
200  km. 

While  the  mesometeorol ogi cal  community  considers  time 
scales  whose  upper  limits  are  6-12  hours,  cons  i  derati  on  is 
given  in  this  study  to  weather  forecasting  precision  extended 
over  a  longer  period.  It  appears  most  useful  for  discussions 
with  Army  operator-users  of  weather  forecast  information  to 
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consider  the  continuum  of  weather  forecasting  precison  over 
longer  periods  but  with  emphasis  on  the  mesoscale  time  period 
(before  forecasting  precision  has  deteriorated  to  uninteresting 
levels ) . 

Appendix  C  contains  a  more  complete  discussion  of  meso- 
meteorology.  Appendix  D  contains  descriptions  of  the  fore¬ 
casting  techniques  indicated  in  Exhibit  4. 
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EXHIBIT  5:  UTILITY  OF  MESOSCALE  WEATHER  FORECASTING 


TACTICAL 

UTILITY 


CLIMATOLOGY  CLIMATOLOGY  + 

today's  WX 

1985 

PERSISTENCE 

FORECASTING 

BEST 

MWF 

PERFECT 

PREDICTIONS 


SYSTEM 

MESOSCALE  WEATHER  FORECASTING  PRECISION3 


Precision  =  spatial  and  temporal  accuracy  of  predicted  wx 

COMPARED  TO  OBSERVED  WX  OF  THE  FORECAST  PERIOD 
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EXHIBIT  5 


Theoretically,  the  utility  of  combat  forces  and  combat 
support  forces  in  tactical  operations  is  a  function  of,  among 
other  things,  the  capability  of  the  supporting  weather  fore¬ 
casting  system.  If  tactical  planning  were  based  on  a  minimum 
of  weather  information,  say,  climatology,3  one  would  expect  some 
incremental  utility  over  the  utility  when  not  even  an  almanac 
is  available.  If,  in  addition  to  climatology,  tactical  planning 
could  also  factor  in  persistence  (weather  during  the  next  time 
period  will  be  the  same  as  currently  observed  or  the  pattern  of 
weather  during  the  next  period  will  be  the  same  as  the  weather 
pattern  over  the  present  peri od- -e . g .  ,  day-to-day  fog  formation 
in  the  San  Francisco  area),  utility  should  be  even  better.  And 
if  today's  numerical  and  statistical  weather  forecasting  tech¬ 
niques  are  also  used  to  provide  weather  information,  tactical 
utility  might  be  better  yet. 

While  it  appears  conceptually  reasonable  that  combat  forces 
and  combat  support  forces  might  be  utilized  more  effectively  or 
efficiently  as  weather  forecasting  precision  is  increased, 
quantifying  the  relationship  between  tactical  utility  and 
weather  forecasting  precision  is  difficult  because  of  the 
numerous  ways  in  which  tactical  utility  can  be  manifested  and 
because  several  elements  are  needed  to  describe  weather  fore¬ 
casting  precision  (viz.,  time,  space,  and  weather  parameter). 
Indeed,  even  scaling  the  five  rank-ordered  levels  of  weather 


aAverage  local  weather  conditions  for  a  period  of  time  (as 
provided,  for  example,  by  an  almanac). 
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forecasting  precision  shown  in  Exhibit  5  is  itself  difficult 
(quite  likely  the  differences  in  capabilities  are  not  equal  as 
indicated).  A  comparison  of  mesoscale  weather  forecasting  pre¬ 
cision  for  1977  and  for  1985  is  developed  in  the  following 
section . 

The  objective  of  Phase  1  of  this  task  is  to  determine  the 
incremental  tactical  utility  that  can  be  expected,  given  the 
best  MWF  capability  that  might  be  achieved  by  1985.  Since  there 
appears  to  be  no  viable  way  for  quantifying  the  relationship  of 
utility  and  weather  forecasting  capability,  without  oversimpli- 
cations  such  as  indicated  in  comments  related  to  Exhibit  8,  the 
improvement  in  utility  will  be  estimated  by  subjective  operator- 
user  data  collected  at  various  Army  schools  and  commands. 

Since  a  weather  forecasting  system  which  would  produce 
perfect  predictions  cannot  now  be  defined,  nor  its  cost  esti¬ 
mated,  consideration  is  not  given  to  such  a  hypothetical  capa¬ 
bility. 


FORECAST  RELIABILITY 


EXHIBIT  6:  CHARACTERIZATION  OF  WEATHER  FORECASTING  PRECISION 


EXAMPLE:  VISIBILITY  IS  FORECAST  TO  BE 
<  V  MILES  (OR  >V  MILES) 


“RELIABILITY  = 

1-14-78-5 


NO.  OF  EVENTS  IN  WHICH  A  SPECIFIED  WX  STATE 
IS  FORECAST  AND  OBSERVED _ 


NO.  OF  EVENTS  IN  WHICH  A  SPECIFIED  WX  STATE 
IS  OBSERVED 
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EXHIBIT  6 


Forecast  reliability  is  defined  from  the  standpoint  of  the 
operator-user  who  wants  to  know  the  "batting  average"  (i.e., 
cumulative  average  accuracy)  of  the  forecaster  or  forecasting 
system  based  upon  past  predictions  as  an  indicator  of  confidence 
he  should  place  in  current  predictions.  Ouite  reasonably,  he 
would  be  expected  to  equate  the  batting  average  with  the  prob¬ 
ability  that  a  currently  forecast  weather  event  will  actually 
occur. 

The  example  shown  uses  1977  data  (see  Exhibit  16)  from  the 
National  Weather  Service  to  illustrate  the  characterization  of 
weather  forecastina  precision:  forecast  reliability  as  a  func¬ 
tion  of  (1)  time  after  the  forecast  is  issued  and  (2)  frequency 
of  the  weather  event.  Forecast  reliability  very  shortly  after 
forecast  issuance  (i.e.,  forecast  duration  ecuals  zero)  is  based 
on  assumptions  indicated  in  Exhibit  12. 

The  process  for  determining  accuracy  of  a  weather  forecast 
by  comparing  the  predicted  weather  with  the  observed  weather  of 
the  forecast  period  is  called  forecast  verification,  whose  prin¬ 
cipal  purposes  are  the  testing  of  forecasting  skills  and  methods. 
As  will  be  shown  in  the  next  section  (Exhibits  14  and  15),  veri¬ 
fication  data  indicate  a  high  correlation  between  forecast  reli¬ 
ability  and  frequency  of  the  weather  event  of  concern. 
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EXHIBIT  7:  WEATHER  PARAMETERS  OF  PRIMARY 
CONCERN  TO  UTILIZATION  OF  WEAPON 
SYSTEMS  IN  TACTICAL  OPERATIONS 

EQfi 


TARGET  ACQUISITION  AND 
WEAPON  DELIVERY 


MOBILITY  PRECIPITATION 

(AMOUNT  AND  RATE)3 


PARAMETER 

VISIBILITY 

CEILING 


IN  CONJUNCTION  WITH  OTHER  FACTORS— SUCH  AS  SOIL  TYPE 
AND  CONDITION,  SURFACE  RELIEF,  DRAINAGE,  VEGETATION, 
ETC.— PRECIPITATION  DETERMINES  TRAFFICABILITY,  A  MORE 
COMPLETE  INDEX  OF  GROUND  MOBILITY. 
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EXHIBIT  7 

The  Army  Training  and  Doctrine  Command  has  identified  50 
environmental  parameters  of  interest  to  various  Army  users  of 
weather  information  (Ref.  6).  In  view  of  the  time  and  manpower 
constraints  of  this  study  effort,  only  those  environmental  param¬ 
eters  of  primary  concern  to  the  utilization  of  weapon  systems  in 
tactical  operations  are  considered. 

Selection  of  visibility,  ceiling,  and  precipitation  as  the 
primary  weather  parameters3  was  endorsed  by  several  Army  officers 
whose  advice  was  sought.  Because  of  their  consideration  by 
several  Army  branches,  surface  winds  are  also  considered  in  this 
study. 


aAl ternati vely  described  as  "environmental"  or  "weather  mani¬ 
festation"  parameters. 
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EXHIBIT  8:  BAD  WEATHER  (WX)  FOR  TACTICAL  OPERATIONS 

DEFINITION:  WX  WHICH  LIMITS  PERFORMANCE  OF  EQUIPMENT  AND 
PERSONNEL  TO  LESS  THAN  LIMITS  IMPOSED  BY 

(1)  INHERENT  PHYSICAL  CHARACTERISTICS  OR 

(2)  TERRAIN  CONSTRAINTS 

EXAMPLES:  LOW  VISIBILITY,  LOW  CEILINGS,  HEAVY  RAIN, 
HIGH  WINDS 

SIGNIFICANCE:  POTENTIAL  PAYOFF  FROM  RELIABLE  FORECASTING 
APPEARS  HIGHER  FOR  BAD  WX;  EQUIPMENT  AND 
PERSONNEL  CAN  BE  DEPLOYED- ALL  ELSE  BEING 
EQUAL— SO  THE  FULL  POTENTIAL  OF  THEIR 
PERFORMANCE  ENVELOPES  CAN  BE  UTILIZED 
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EXHIBIT  8 


Tactical  deployments  of  weapons  are  assumed  to  be  made 
normally  without  regard  to  weather  forecasts  (although  one  can 
conceive  of  consideration  of  climatology  possibly  influencing 
decisions  on  weapon  system  deployment  to  a  theater).  The  normal 
deployment  may  "waste"  potential  effectiveness  of  some  weapon 
systems  during  periods  in  which  weather,  rather  than  inherent 
physical  characteristics  or  terrain  constraints,  limits  their 
performance.  Theoretically,  at  least,  redeployment  of  weapon 
systems  (ATWs,  for  example)  to  areas  where  their  full  perform¬ 
ance  envelopes  can  be  utilized  would  provide  a  number  of  weapon- 
hour-kma  of  potential  additional  effectiveness  at  the  new  loca¬ 
tions.  The  viability  of  such  a  concept  remains  to  be  evaluated 
with  Army  personnel. 

If  forces,  or  force  elements,  are  to  be  utilized  more  ef¬ 
fectively  or  efficiently.  It  appears  such  improved  utilization 
must  reasonably  take  advantage  of  periods  of  "bad"  weather, 
where  "bad"  is  defined  differently  for  different  weapon  systems. 
For  example,  bad  weather  for  several  antitank  weapons  (ATWs) 
and  tank  guns  is  1,  2,  or  3  km  corresponding  to  the  maximum 
effective  range  of  the  specific  type  weapon.  Bad  weather  for 
helicopter  operations  might  be  ceil ing/visibi 1 ity  less  than 
500  ft/2  miles  in  hilly  terrain  or  less  than  200  ft/1  mile  in 
flat  terrain. 


a ( No .  of  ATWs  redeployed)  x  (No.  of  hours  each  is  temporarily 
redeployed)  x  (Maximum  effective  range  of  ATW  minus  visibility 
at  original  location). 
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EXHIBIT  9:  WEATHER  FORECAST  PARAMETERS 


•  FORECAST  RELIABILITY  (DEFINED  IN  EXHIBIT  6) 

FOR  VARIOUS  VISIBILITY,  CEILING,  PRECIPITATION 
EVENTS  OR  STATES 

•  SPATIAL  RESOLUTION,  KM  x  KM 

GEOGRAPHICAL  SPACE  WITHIN  WHICH  WEATHER  EVENTS 
CAN  BE  FORECAST 

•  FORECAST  DURATION,  HR 

TIME  FOR  WHICH  RELIABILITY  IS  HIGH  ENOUGH 
TO  MAKE  PREDICTIONS  POTENTIALLY  USEFUL 

•  PLANNING-PREPARATION  TIME,  HR 

TIME  DURING  WHICH  OPERATIONAL  PLANS  ARE  FORMU¬ 
LATED  AND  FORCES  PREPARED  FOR  ACTION 
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EXHIBIT  9 


Exhibit  9  identifies  the  parameters  considered  most  useful 
in  characterizing  weather  forecast  precision  and  in  utilizing 
weather  forecasts.  First,  reliability  as  previously  defined  is 
used  as  a  parameter  characterizing  forecast  precision.  And  ob¬ 
viously  the  reliabilities  of  visibility,  ceiling,  and  precipi¬ 
tation  forecasts  are  important  since  these  are  the  weather 
parameters  of  primary  concern.  Another  parameter  characteriz¬ 
ing  forecast  precision  is  of  course  the  spatial  resolution,  or 
space  scale,  within  which  weather  events  can  be  forecast. 

Connected  to  reliability  of  forecast  is  forecast  duration, 
the  time  for  which  forecasts  can  be  made  with  sufficient  relia¬ 
bility  to  be  useful  to  the  planner.  And  related  to  forecast 
duration  is  the  planning-preparation  time  required  by  tactical 
operators  to  take  advantage  of  the  weather  forecasts.  Planning 
typically  involves  details  of  force  firepower  employment  and 
logistical  support;  preparation  may  involve  moving  personnel 
and  equipment,  additional  maintenance  periods  to  improve  equip¬ 
ment  availability,  and  building  up  supply  stocks. 
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EXHIBIT  10:  ANOTHER  FORM  OF  FORECAST  UNRELIABILITY 


INCOMPATIBILITY  OF  AREA  FORECASTING  AND  POINT  OBSERVATIONS  CAN  CAUSE  LARGE 
DIFFERENCES  IN  WEATHER  FORECAST-OBSERVATION  AGREEMENTS  (AND  THUS  RELIABILITY) 
DEPENDING  ON  (1)  WEATHER  EVENT  OF  INTEREST,  (2)  TERRAIN  FACTORS,  AND  (3)  SCORING 
METHOD  ADOPTED  FOR  MAKING  FORECAST-OBSERVATION  AGREEMENT  DECISIONS. 


EXPECTED 

TERRAIN  INFLUENCE 

WEATHER  EVENT 

RELIABILITY  3 

MINOR 

PRECIPITATION  >  1  INCH 

FORECAST  IN9L2UNITS 
OBSERVED  IN  7  L^ UNITS 

7/9  (FRACTIONAL  COVERAGE 
SCORING) 

OBSERVED  AT  2  STANDARD 
POINTS 

2/9  (STANDARD  POINT 
SCORING) 

MAJOR 

VI  SIBILITY<1  KM 

FORECAST  IN  7  L2  UNITS 

OBSERVED  IN  7  L2  UNITS 

7/7 

NO.  OF  EVENTS  IN  WHICH  SPECIFIED  WEATHER  STATE 

3 nr,  IAR(I  i TY _ IS  FORECAST  AND  OBSERVED _ 

KtL imd il i  i  t  -  N0  OF  EVENTS  IN  WHICH  SPECIFIED 

WEATHER  STATE  IS  OBSERVED 

WHERE  "EVENT”  MEANS  WEATHER  STATE  IN  AN  L  x  L  GRID  UNIT. 
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EXHIBIT  10 


The  form  adopted  for  expressing  weather  forecasting  pre¬ 
cision,  viz.. 

Reliability  (R) 

introduces  an  identifiable,  measurable  degree  of  unreliability 
(i.e.,  1.0-R)  from  the  perspective  of  a  tactical  commander. 
However,  in  verification  of  weather  forecasts,  i.e.,  comparing 
the  forecast  weather  (F)  with  the  observed  weather  (0)  of  the 
forecast  period,  another  form  of  unrel iabil ity--not  so  identi¬ 
fiable  nor  measurabl e--may  be  introduced.  This  forecast  unre¬ 
liability  is  due  to  errors  incidental  to  scoring  agreement  (or 
nonagreement)  between  F  and  0.  As  an  example,  suppose  precipi¬ 
tation  is  predicted  in  an  area  3L  x  3L  containing  9  mesoscale 
grid  units  as  part  of  a  fine-mesh  modeling  system.  If  precipi¬ 
tation  is  observed  for  the  period  of  the  forecast  to  cover  the 
cross-hatched  portion  of  the  3L  x  3L  area  in  Exhibit  10,  agree¬ 
ment  between  F  and  0  may  be  very  good  if  the  scoring  standard 
is  the  observance  of  precipitation  in  any  part  of  each  L  x  L 
mesoscale  grid  units.  If  the  scoring  standard  for  determining 
agreement  between  F  and  0  is  the  observance  of  precipitation 
at  the  center  of  each  L  x  L  grid  unit,  forecast  reliability 
may  appear  to  be  quite  poor.  Thus,  scoring  methods  for  deter¬ 
mining  F-0  agreement  may  distort  forecast  reliability  because 
of  inconsistency  between  mesoscale  area  forecasting  and  point 
observations;  since  spatial  resolution  of  the  weather  forecast 
is  at  the  L  x  L  level,  forecast  reliability  (no  matter  how  good) 


(No.  of  events  in  which  a  specified  weather 
state  is  forecast  and  is  observed  > 
/No.  of  events  in  which  a  specified\ 

I  weather  state  is  observed  j 
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may  not  convey  predictability  of  fractional  coverage  (amount 
and  location)  of  an  L  x  L  area  by  a  weather  event. 

However,  there  also  appear  to  be  circumstances,  involving 
particular  weather  events  and  terrain  effects  not  important  to 
large-scale  meteorology,  in  which  the  above  defect  in  scoring 
methods  for  determining  F-0  agreement  is  not  a  factor.  For 
example,  suppose  the  cross-hatched  area  in  Exhibit  10  represents 
a  valley  surrounded  by  hills  in  the  3L  x  3L  area.  If  the  weather 
event  of  interest  is  fog  (and  consequent  low  visibility  which 
might  be  of  interest  to  a  tactical  commander),  a  mesoscale 
weather  forecast  might  well  be  able  to  predict  morning  fog  in 
specific  portions  of  the  grid  units  over  which  the  sky  is  clear, 
the  relative  humidity  at  sunset  is  high,  and  the  wind  is  light, 
because  these  conditions,  already  conducive  for  the  formation 
of  radiation  fog,  are  also  reinforced  by  heavy  colder  air  flowing 
down  from  surrounding  hills  at  night. 

Thus,  a  hidden  degree  of  uncertainty  may  be  incidental  to 
the  reliability  of  the  mesoscale  weather  forecast,  depending  on 
the  combination  of  particular  weather  event  and  terrain. 
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III.  VALUES  OF  WEATHER  FORECASTING  PARAMETERS 


EXHIBIT  PAGE 
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Weather  Forecasts 
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EXHIBIT  11:  ESTIMATES  OF  VALUES  FOR 
SPATIAL  RESOLUTION  AND  DURATION  OF 
WEATHER  FORECASTS 


TYPE 

SCALE 

SPATIAL 

RESOLUTION, 

KM 

FORECAST 

DURATION, 

HR 

1977 

1985 

1977 

1985 

MACROSCALE a 

200 

200 

24-48  24-48 

MESOSCALE 
(Coarse  Mesh) 

35 

24 

MESOSCALE 
(Fine  Mesh) 

4 

4 

12 

12 

MICROSCALE 

<  1 

<  1 

1 

1 

aVALUES  GIVEN  FOR  LIMITED  AREA  FINE  MESH  MODEL 
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EXHIBIT  11 

Values  for  spatial  resolution  and  forecast  duration  param¬ 
eters  are  estimated  on  the  basis  of  discussions  with  personnel 
involved  in  weather  forecasting  R&D  at  the  National  Oceanographic 
and  Atmospheric  Administration  (N0AA)a  and  the  Drexel  University.*3 

The  improvement  in  spatial  resolution  by  1985  is  the  pro¬ 
jected  result  of  development  of  a  "regional  scale"  numerical 

c 

weather  prediction  model  with  a  grid  mesh  size  of  about  35  km. 

At  the  lower  end  of  the  mesospatial  scale,  fine-mesh  modeling 

by  model  output  statistics  (MOS)  is  expected  to  provide  about 

the  same  spatial  resolution  of  weather  events  as  MOS  provides 

2 

today,  i.e.,  4  x  4  km  .  The  impact  of  the  regional  scale,  or 
coarse  mesh  mesoscale,  capability  is  expected  in  the  form  of 
additional  input  data  for  the  fine-mesh  mesoscale  model,  thus 
enhancing  the  reliability  of  MOS  predictions.  Optimistic  pro¬ 
jections  of  the  consequent  improvements  are  shown  in  Exhibit  15. 

While  the  period  of  most  expected  usefulness  of  coarse 
mesh  mesoscale  weather  prediction  should  remain  in  1985  on  the 
order  of  24  hours  beyond  the  time  of  latest  observation,  fine*' 
mesh  mesoscale  predictions  are  expected  to  be  useful  for  periods 
up  to  about  12  hours.0 

The  fine-mesh  mesoscale  forecasts  of  interest  in  this  study 
are  conditional  forecasts  in  that  they  are  based  on  the  assump¬ 
tion  that  larger  scale  forecasts  (i.e.,  macroscale  in  1977  and 
macroscale  plus  coarse  mesh  mesoscale  in  1985)  are  accurate. 

aDr.  John  Brown  of  the  National  Meteorological  Center,  National 
Weather  Service  (NWS),  and  Dr.  Harry  Glahn  of  the  Techniques 
Development  Laboratory,  NWS. 

^Dr.  Carl  Kreitzberg  of  the  Department  of  Physics  and  Atmos¬ 
pheric  Science. 

cFrom  Reference  5  in  which  "regional  scale"  is  equivalent  to 
"coarse  mesh  mesoscale"  in  this  study. 
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FORECAST  RELIABILITY  „  FORECAST  RELIABILITY 


EXHIBIT  12:  SOME  ASSUMPTIONS  IN  ESTIMATING 
RELIABILITY  OF  WEATHER  FORECASTS 


•  FRESH  OBSERVATIONS 
•INSTANTANEOUS  PREPARATION 


MAKE  INITIAL  RELIABILITY  PERFECT 


EXHIBIT  12 


Forecast  verification  data  indicate  that  verification 
(comparing  predicted  weather  of  a  forecast  period  with  the 
observed  weather  of  that  period)  is  usually  made  3,  6,  12, 
and  24  hours  after  issuance  of  the  forecast.  While  typical 
"guidance"  forecast  preparation  time  is  about  one  hour  and 
observation  data  on  which  the  forecast  is  based  are  typically 
two  hours  old  when  forecast  preparation  is  begun,3  variations 
in  preparation  times  and  in  freshness  of  the  observation  data 
bases  are  expected  but  unknown.  And  while  preparation  time 
and  age  of  data  base  are  typically  even  less  (than  one  hour 
and  two  hours,  respectively)  for  "local"  forecasts,  "persis¬ 
tence"  forecasts  are,  of  course,  perfect  "now-casts." 

Therefore,  it  is  assumed  that  fresh  observations  and  in¬ 
stantaneous  preparation  make  the  forecasts  perfectly  reliable 
at  issuance,  as  indicated  in  the  top  sketch  and,  thus,  the 
axis  of  the  abscissas  represents  time  elapsed  since  forecast 
issuance. 

Descriptions  of  the  three  mesoscale  weather  forecasting 
-►^techniques  are  included  in  discussion  accompanying  Exhibit  15. 

The  axes  of  the  ordinate  in  Exhibit  12  are  not  scaled  and 
the  sketches  are  simply  notional  illustrations. 


Estimates  of  time  delays  are  based  on  discussions  with 
Lt.  Colonel  Karl  Hebenstreit,  USAF,  assigned  to  the 
Techniques  Development  Laboratory,  NWS. 
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EXHIBIT  13 


With  the  example  introduced  in  Exhibit  6  and  with  forecast 
reliability  data  shown  later  (see  Exhibit  16),  this  exhibit  il¬ 
lustrates  the  method  of  projecting  forecast  reliability  for 
1985.  While  background  details  follow,  1985  projections  are 
based  directly  on:  (1)  predictions  of  various  weather  events 
nine  hours  from  issuance  being  as  reliable  as  1977  predictions 
of  similar  events  three  hours  from  issuance,  (2)  perfect  reli¬ 
ability  at  forecast  issuance,  and  (3)  an  arbitrary  curve  through 
those  two  points  and  with  a  slightly  slower  rate  of  decay  then 
exhibited  by  the  verification  data  for  1977. 

Methodology  currently  used  by  the  National  Weather  Service 
(NWS)  and  the  USAF  Air  Weather  Service  (AWS)  to  validate  weather 
forecasts  is  described  in  Appendix  E.  The  basis  for  projecting 
forecast  reliability  for  1985  is  described  in  Appendix  F. 

Statistical  summaries  of  NWS  verification  of  operational 
forecasts  at  many  stations  in  the  U.S.  during  the  fall-winter 
period  of  1975-76  are  used  as  a  basis  for  estimating  1977  fore¬ 
cast  reliability.  Similar  AWS  statistical  summaries  of  forecast 
verification  at  European  stations  during  the  same  seasons  a  year 
later  are  also  considered.  These  statistical  summaries,  con¬ 
tained  in  Appendix  G,  are  the  distillation  of  recent  independent 
efforts  of  the  NWS  and  the  AWS  to  evaluate  their  forecasting 
skills  and  methods. 

Projections  for  1985  are  based  on  assuming  that  past  im¬ 
provements  (over  nearly  the  last  three  decades)  of  synoptic 
forecasting  (using  numerical  weather  prediction  model s )  over 
persistence  forecasting  of  a  relatively  easy-to-pred i ct  param¬ 
eter,  the  height  of  the  500-mbar  pressure  level  (see  Appendix 
F)  is  an  indicator  of  the  near-term  (next  decade)  improvements 

^3 


in  forecasting  more  difficult  (relatively)  parameters,  such  as 
visibility,  ceiling,  and  precipitation  (see  last  section  of 
Appendix  E).  Thus,  the  1985  projections  are  based  on  optimistic 
assumptions  of  future  improvements  in  mesoscale  weather  fore¬ 
casting. 

The  high  correlation  between  forecast  reliability  and 
weather  event  frequency  is  developed  and  discussed  in  Exhibits 
14  and  15. 
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OF  CATEGORICAL  FORECAST  OF  VISIBILITY  (  E.  G. ,  0<V<0.8) 
OF  ALL  VISIBILITY  OBSERVATIONS 


Exhibit  14 


The  histogram  is  based  on  test  data  from  the  Techniques 
Development  Laboratory,  NWS,  and  contained  in  Appendix  G.  The 
data,  resulting  from  NWS  efforts  to  verify  local  forecasts,3 
show  that  low  forecast  reliability  is  typically  associated  with 
relatively  infrequent  events  and  that  high  reliability  is  typi¬ 
cally  associated  with  events  which  are  relatively  frequent. 

A  frequency  distribution  of  the  observations  is  given  in  the 
following  tabulation. 


Visibil ity  (V) ,  km 

<0.8 

<1  .6 

<4.8 

<8 

*8 

Total 

No .  of  Observations 

260 

508 

1477 

2352 

1  2970 

1  5322 

Fraction  of  Total 

0.02 

0.04 

0.10 

0.15 

0.85 

1  .00 

While  the  data  indicate  that  low  forecast  reliabilities  cor¬ 
respond  to  low  visibilities  and  high  reliabilities  to  good  visi¬ 
bilities,  that  correlation  exists  because  only  a  small  fraction 
of  the  NWS  observations  (at  92  stations  throughout  the  contig¬ 
uous  U.S.  during  October  1975  to  March  1976)  indicated  the  ex¬ 
istence  of  low  visibilities  (i.e.,  low  enough  to  be  classified 
as  "bad"  weather  as  defined  and  discussed  in  Exhibit  8).  In 
certain  locales  and  in  certain  periods  of  the  year,  one  can  ex¬ 
pect  frequent  occurrences  of  bad  weather  and,  therefore,  low 
correlation  between  forecast  reliability  and  goodness  of  visi¬ 
bility.  To  illustrate,  while  good  visibility  (say,  *  8  km)  is 


aIt  is  assumed  that  the  distribution  of  the  approximately 
15,000  observations  in  the  verification  testing  is  similar 
to  the  distribution  of  all  weather  event  occurrences,  i.e., 
the  observations  represent  a  large  random  sample  from  the 
universe  of  occurrences. 


usually  an  appropriate  forecast  for  White  Sands,  New  Mexico, 
where  such  a  weather  event  is  nearly  an  everyday  occurrence, 
low  visibility  due  to  morning  fog  in  the  fall  and  winter  is 
also  a  relatively  frequent  occurrence,  for  example,  in  many  of 
the  valleys  in  the  Appalachian  Mountains  and  in  valleys  of 
central  West  German  hill  country.  Similarly,  poor  visibility 
and  low  ceilings  are  frequent  West  Coast  weather  events,  which 
can  be  quite  reliably  predicted  as  a  consequence  of  the  Pacific 
Coast  fog  produced  during  parts  of  the  year. 

Data  used  in  a  current  study  at  the  Institute  for  Defense 
Analyses  on  the  effect  of  weather  and  atmosphere  on  sensor  per¬ 
formance  (Ref.  8)  indicate  that  during  West  German  winters, 
(worst  weather  periods)  weather  conditions,  in  which  visibility 
is  less  than  one  mile,  exist  less  than  15%  of  the  time  at  many 
locations.  However,  one  should  not  conclude  that  such  low  visi¬ 
bility  is  a  relatively  infrequent  event  in  all  parts  of  central 
West  Germany  since  most  meterol ogi cal  data  are  from  observations 
at  stations  at  or  near  airfields  where  better  conditions  would 
be  expected  than  in  mesoscale  areas  more  susceptible  to  fog 
formation . 


While  the  ex am pie  shown  in  Exhibit  14  pertains  to  a  6-hour 
local  forecast  of  visibility,  one  can  observe  similar  relation¬ 
ships  between  forecast  reliability  and  frequency  of  weather 
event:  (1)  for  other  types  of  weather  events  (e.g.,  ceiling 

<  C  ft);  (2)  for  other  forecast  durations  (3,  9,  12  hours,  etc.) 
(3)  in  another  data  source  (about  250,000  AWS  verification  ob¬ 
servations  collected  at  35  European  stations  from  September  1976 
to  March  1977);  and  (4)  for  other  forecasting  techniques.  Ex¬ 
hibit  15  compares  forecast  reliabilities  of  the  three  mesoscale 
weather  forecasting  techniques,  which  include  "persistence"  and 
"guidance"  in  addition  to  "local,"  the  technique  used  in  this 
exampl e . 


RELIABILITY  OF  FORECAST  OF  VISIBILITY  V  KM 


EXHIBIT  15:  PROJECTED  IMPROVEMENT  IN  RELIABILITY 
OF  MESOSCALF  FORECASTS 

(example:  6-hour  forecast  of  visibility  <  V  km) 


0  0.8  1.6  4.8  8  00 

VISIBILITY  (V),  KM 

1-24-78-1 
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EXHIBIT  15 


A  comparison  of  the  reliability  of  three  MWF  techniques, 
which  are  briefly  described  below,  is  illustrated  by  continuing 
the  analysis  of  the  example  in  Exhibit  14. 

PERSISTENCE:  A  forecast  that  the  future  weather  condition 
during  the  time  interval  of  the  forecast  will  be  the  same  as 
that  existing  now  (Appendix  D)  or  during  a  current  time  interval. 
The  basis  of  this  technique  is  observational  data. 

LOCAL:  A  manual  forecast  for  which  the  mesometeorol ogi st 
uses  numerical  guidance  from  computer  products,  mesocl imatol og- 
ical  data,  and/or  subjective  factors.  Other  popular  names  for 
this  technique  are  "subjective,"  "man,"  or  "station." 

GUIDANCE:  A  model  output  statistics  (MOS)  forecast  for 
which  statistical  methods  are  used  to  complement  raw  output  of 
numerical  prediction  models.  The  MOS  method  matches  local 
weather  observations  with  numerical  model  results  and  then  de¬ 
rives  forecast  equations  by  statistical  techniques  such  as  screen 
ing  regression  and  regression  estimation  of  event  probabilities. 
This  automated  technique  builds  into  the  forecasting  system  some 
corrections  for  the  bias  and  inaccuracy  of  .he  numerical  model 
as  well  as  the  local  climatology  (Ref.  7).  Popular  names  for 
this  technique  are  "MOS"  and  "objective." 

While  empirical  data  provide,  for  each  MWF  technique,  high 
reliability  values  for  very  high  frequency  weather  events  and  a 
scattering  of  low  reliability  values  for  very  low  frequency 
events,  no  data  are  available  for  events  which  occur  or  are  ob¬ 
served  at  medium  frequencies.  It  is  assumed  that  the  interpo¬ 
lations  shown  between  the  low  frequency  data  points  and  the  high 
frequency  data  points  in  Exhibit  15  are  reasonable  approximations 
of  forecast  reliabilities  over  the  Intermediate  frequencies. 
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Given  that  assumption,  one  can  see  that  (1)  NWS  persistence 
forecasts  are  slightly  better  than  local  or  guidance  (1977)  fore¬ 
casts  for  infrequent  events,  and  (2)  all  three  MWF  techniques 
provide  similar  reliabilities  for  about  90%  of  the  events.  The 
same  observation  applies  to  12-hour  forecasts  of  visibility  and 
to  6-  and  12-hour  forecasts  of  ceiling  (see  Table  G-48,  Appendix  G). 

USAF  AWS  data  (also  found  in  Appendix  G)  from  verification 
testing  at  European  stations  indicate  AWS  local  (called  "station" 
by  AWS)  forecasts  are  slightly  better  than  AWS  persistence  fore¬ 
casts.  The  AWS  does  not  utilize  the  guidance  forecasting  tech¬ 
nique. 

The  guidance  (1985)  line  represents  an  estimated  upper 
bound  of  MWF  capability  discussed  in  Appendix  F.  Bases  for  the 
projected  improvement  in  forecasting  such  parameters  as  visi¬ 
bility,  ceiling,  precipitation,  and  surface  winds  are  (1)  intro¬ 
duction  of  the  mesoscale  numerical  weather  prediction  (MNWP) 
model  (35-km  spatial  resolution)-,  (2)  improved  MOS  performance 
because  of  better  inputs  (from  the  MNWP  model  rather  than  from 
the  NWP  model  whose  spatial  resolution  is  about  200  km)  and 
because  of  improved  modeling  of  physical  processes;  and  (3)  more 
observations  for  the  NWP  model,  whose  synoptic  output  is  utilized 
by  the  MNWP  model,  and  for  the  MNWP  model  itself. 

Although  guidance  is  presently  the  poorest  mesoscale  weather 
forecasting  (MWF)  technique,  all  three  MWF  techniques  are  poor 
in  predicting  infrequent  events.  And  whereas  significant  im¬ 
provements  in  the  guidance  technique  appear  reasonable,  and  have 
been  estimated  in  this  analysis  with  the  aid  of  experts  in  the 
mesometeorol ogical  community,  significant  improvements  in  fore¬ 
cast  reliability  are  not  expected  for  either  the  persistence  or 
the  local  MWF  technique.  Thus,  the  guidance  (1985)  line  in 
Exhibit  15  is  typical  of  the  most  optimistic  projection  of  MWF 
precision  to  be  made  on  the  basis  of  all  of  the  data  and  advice 
provided  by  the  mesometeorological  community. 
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EXHIBIT  16:  FORECAST  RELIABILITY  FOR  VISIBILITY 
CEILING,  PRECIPITATION,  AND  SURFACE  WINDS 


1977 

1985 

1977 

1985 

1977 

1985 

1977 

1935 

1977 

1985 

VISIBILITY  (V), 

STATUTE 

MILES 

(mi). 

AND  KILOMETERS  (km) 

FORECAST 

PROJECTION, 

HR 

V  < 

V  < 

,5  MI 

,8  KM 

V  < 

V  < 

1  MI 

1.6  KM 

V  <  3  MI 

V  <  4.8  KM 

V  <  5 

V  <  8 

MI 

KM 

V  4  5  mi 

V  4  8  KM 

6 

37 

61 

37 

61 

61 

44 

66 

94 

97 

12 

24 

24 

23 

37 

57 

92 

96 

24 

14 

44 

14 

44 

44 

29 

50 

91 

94 

CEILING  (C),  FEET  (ft) 

FORECAST 

PROJECTION, 

_ _ ^ _ 

C  < 

200 

_ 

C  < 

500 

C  <  1000 

C  <  2000 

C  4  2000 

6 

27 

53 

41 

62 

50 

68 

58 

75 

93 

12 

17 

41 

28 

54 

38 

60 

50 

67 

89 

24 

12 

34 

20 

50 

31 

56 

46 

64 

85 

PRECIPITATION  (P),  INCHES  (iN.) 

FORECAST 

PROJECTION, 

HR 

P 

*  1 

P  * 

0.5 

P  = 

0 

FALL- 

WINTER 

SUMMER 

FALL-WINTER 

SUMMER 

ANY  SEASON 

24 

58 

73 

33 

41 

69 

86 

49 

61 

92 

95 

43 

37 

46 

25 

31 

48 

34 

43 

87 
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HR 
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23 
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8  s  VI 

*  12 

VI 
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6 

32 

60 

60 

79 

79 

70 

88 

36 

95 

12 

20 

41 

41 

67 

47 

67 

57 

78 

76 

90 

18 

14 

31 

31 

59 

59 

50 

71 

68 

88 

30 

12 

22 

22 

49 

33 

49 

44 

63 

60 

82 

42 

11 

19 

19 

44 

44 

42 

48 

55 

78 

EXHIBIT  16 


The  data  base  for  Exhibit  16  is  contained  in  Appendix  G. 
Sources  of  the  1977  data,  from  forecast  verification  efforts, 
are  the  Techniques  Development  Laboratory  of  NWS  for  visibility, 
ceiling,  and  surface  winds;  the  National  Meteorological  Center 
of  the  NWS  for  precipitation  amounts  greater  than  0;  and  the 
USAF  AWS  for  zero  precipitation  data. 

NWS  data  are  used  rather  than  AWS  data  for  visibility  and 
ceiling  because  of  better  data  resolution:  the  former  is  cat¬ 
egorized  in  five  increments  while  AWS  uses  four  categories  for 
its  forecast  verification  data. 

Projected  forecast  reliabilities  for  1985  are  based  on  re¬ 
alization  of  improvements  in  guidance  forecasting  summarized  in 
Exhibit  15.  As  discussed  in  Exhibit  13  and  Appendix  F,  quanti¬ 
fication  of  projected  improvements  is  based  on  an  optimistic 
assumption  that  improvement  over  nearly  the  next  decade  in  fore¬ 
casting  the  values  of  relatively  di f f i cul t-to-predi ct  parameters 
will  equal  the  observed  improvement  over  nearly  three  decades 
in  forecasting  a  relatively  easy-to-predi ct  parameter. 

The  1985  projections  of  forecast  reliabilities  have  been 
reviewed  by  meteorologists  involved  in  the  usage  and  management 
of  forecasting  systems,  in  weather  forecasting  R&D,  and  in  de¬ 
veloping  forecasting  models.  A  consensus  appraisal  is  that  the 
1985  projections  constitute  an  upper-bound  estimate  of  the  capa¬ 
bility  potentially  available  by  the  mid-1980s;  no  one  considered 
the  projections  as  pessimistic;  in  fact,  many  considered  the 
estimate  to  be  quite  optimistic.  The  reviewers  belong  to  the 
following  organizations: 
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Techniques  Development  Laboratory,  NWS 

USAF  Air  Weather  Service 

National  Center  for  Atmospheric  Research 

U.S.  Army  Training  and  Doctrine  Command  Headquarters 

Pennsylvania  State  University,  School  of  Meteorology 

As  previously  indicated  (Exhibit  8),  reliable  forecasting 
of  bad  weather  events  should  be  significant  for  more  effective 
or  efficient  utility  of  tactical  forces.  Although  one  can  ex¬ 
pect  bad  weather  events  to  occur  frequently  at  certain  locales 
and  in  certain  seasons,  USAF  AWS  weather  data  for  35  European 
stations  (17  in  Germany)  during  fall  and  winter  (the  worst 
weather  seasons)  indicate  that  bad  weather  events  are,  in 
general,  infrequent  events.  (NWS  weather  data  for  92  U.S. 
stations  during  fall  and  winter  indicate  a  similar  phenomenon.) 
Since  the  projected  improvement  in  mesoscale  weather  forecast¬ 
ing  precision  is  relatively  minor  for  frequent  events,  which 
can  already  be  forecast  quite  reliably  (compared  to  forecasts 
of  infrequent  events)  with  present  MWF  capabilities,  emphasis 
is  given  to  bad  weather  events,  for  which  improvements  (albeit 
optimistic)  in  forecasting  reliability  by  1985  are  much  more 
significant. 
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EXHIBIT  17 

Since  potential  improved  utilization  of  tactical  forces 
can  reasonably  be  expected  to  be  associated  mainly  with  bad 
weather  predictions,  the  forecast  reliabilities  of  certain 
potentially  critical  (from  the  standpoint  of  providing  decision 
thresholds)  weather  events,  tabulated  in  the  preceding  exhibit, 
are  graphically  depicted  in  Exhibit  17. 

If,  for  example,  three  hours  from  forecast  issuance,  visi¬ 
bility  <  1  mile  (1.6  km)  or  ceiling  <  1000  ft  constitute  decision 
thresholds,  a  commander  in  1985  could  have,  at  best,  forecasts  of 
these  events  with  0.8  reliability  whereas  today  the  reliabilities 
are  0.6  and  0.7,  respectively,  for  those  visibility  and  ceiling 
states . 

While  the  impact  of  visibility,  ceiling,  and  winds  are 
directly  estimable,  the  effect  of  precipitation  on  ground  mo- 
bility  .is  estimated  by  integrating  precipitation  over  a  period 
of  several  days  and  considering  specifics  of  the  terrain. 
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EXHIBIT  18 


Data  shown  in  Exhibits  16  and  17  represent  average  fore¬ 
cast  reliabilities.  It  can  reasonably  be  expected  that  in 
certain  circumstances  a  forecaster  will  be  more  sure  of  his 
predictions  than  in  others  and  in  particular  situations  he  may 
be  very  sure  of  his  predictions.  For  example,  at  stations 
ahead  of  a  strong,  moving  cold  front,  a  forecaster  might  con¬ 
fidently  predict  precipitation  from  cumulonimbus  or  nimbostratus 
clouds  forming  in  warm  air  just  ahead  of  and  over  the  cold  front. 

Certainly,  weather  forecasts  biased  in  this  way  should  be 
more  highly  valued  in  tactical  decision  making  than  average 
forecasts.  Obviously,  then,  tactical  commanders  and  their  staffs 
should  be  apprised  of  forecaster  confidence,  especially  when  that 
confidence  is  high.  ^ 

While,  unfortunately,  data  appear  not  to  be  available  on 
the  fraction  of  weather  forecasts  which  exceeds  specified  levels 
of  forecaster  confidence,  it  is  not  clear  that  the  improvements 
in  average  MWF  reliability  projected  for  1985  will  significantly 
affect  that  unknown  fraction  of  forecasts  which  are  already 
quite  reliable  today.  And,  of  course,  as  the  specified  confi¬ 
dence  threshold  is  increased,  fewer  forecasts  meet  or  exceed 
the  threshold. 

"Biased  forecasting"  is  used  in  two  contexts  which  differ 
with  respect  to  the  degree  of  certainty  of  the  potential  effects 
of  atmospheric  processes  on  near-future  weather  events.  As 
used  here,  the  term  applies  to  cases  in  which  those  potential 
effects  are  quite  certain.  As  revealed  by  forecast  verification 
data  (and  discussed  in  Appendix  E),  "biased  forecasting"  applies 
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to  the  tendency  of  forecasters,  when  the  potential  effects  of 
atmospheric  processes  are  obscure  or  ambiguous,  to  consider 
statistical  data  in  forecasting  weather  events  more  frequently 
(overbiasing)  or  less  frequently  (underbiasing)  than  those  same 
events  have  been  observed  at  their  stations,  in  order  to  enhance 
their  scores  in  predicting  certain  weather  events. 
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EXHIBIT  19:  SUMMARY  OF  OBSERVATIONS 
RELATING  TO  CURRENT  AND  PROJECTED 
MESOSCALE  WEATHER  FORECAST  RELIABILITY 

1.  FOR  PREDICTING  FREQUENT  WX  EVENTS,  ALL  MWF  TECHNIQUES 
ARE  CURRENTLY  QUITE  RELIABLE,  AND  ONLY  MINOR  RELIABILITY 
IMPROVEMENTS  ARE  EXPECTED  BY  1985. 

2.  FOR  PREDICTING  INFREQUENT  WX  EVENTS,  NO  MWF  TECHNIQUE  IS 
CURRENTLY  VERY  RELIABLE,  AND  ONLY  THE  GUIDANCE  TECHNIQUE 
OFFERS  PROSPECTS  FOR  SIGNIFICANT  RELIABILITY  IMPROVEMENT 
BY  1985. 

3.  BAD  WX  EVENTS,  WHOSE  PREDICTIONS  OFFER  POTENTIAL  FOR 
MORE  EFFECTIVE  OR  EFFICIENT  TACTICAL  USE  OF  WEAPON 
SYSTEMS,  ARE  RELATIVELY  INFREQUENT  EVENTS,  EXCEPT  IN 
CERTAIN  LOCALES  AND  SEASONS,  IN  WHICH  BAD  WX  EVENTS 
ARE  RELATIVELY  FREQUENT  AND  CAN  THUS  BE  CURRENTLY 
PREDICTED  QUITE  RELIABLY. 
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EXHIBIT  19 


The  first  observation  is  supported  by  data  and  discussions 
in  Exhibits  15  and  16. 

The  second  observation  is  based  on  data  and  discussion  in 
Exhibit  15.  "Persistence"  cannot  forecast  continuation  of  a  non 
existent  event.  Since  an  infrequent  weather  state  is  unlikely 
to  be  observed  at  time  of  forecast,  the  "persistence"  technique 
is  also  unlikely  to  predict  its  occurrence  in  the  immediate 
future.  NWS  and  AWS  verification  data  indicate  that  the  "local" 
MWF  technique  is  also  poor  in  predicting  infrequent  weather 
events  unless  biasing  is  involved  (see  discussion  accompanying 
Exhibit  18).  While  "guidance”  appears  to  be  the  only  MWF  tech¬ 
nique  with  prospects  for  improvement  in  reliability  (see  dis¬ 
cussion  accompanying  Exhibit  15),  its  dependence  on  statistics 
means  that  reliable  predictions  of  infrequent  weather  events 
are  also  unlikely. 

The  third  observation  is  based  on  material  in  Exhibits  8 
and  14. 
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EXHIBIT  20:  ARMY  INPUT  SOURCES 


mm 
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ORDNANCE  AND  CHEMICAL  CENTER 

ABERDEEN  PROVING  GROUND 

ENGINEERS 

ENGINEER  SCHOOL 

FT.  BELVOIR 

INFANTRY 

INFANTRY  SCHOOL 

FT.  BENNING 

INTELLIGENCE 

INTELLIGENCE  CENTER 

FT.  HUACHUCA 

ALL 

TRAINING  AND  DOCTRINE  COMM) 

FT.  MONROE 

ALL 

ARMY  WAR  COLLEGE 

CARLISLE  BARRACKS 

ALL 

GOPBINED  ARMS  COFBAT 
DEVELOPMENT  ACTIVITY 

FT.  LEAVENWORTH 
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EXHIBIT  20 

To  obtain  the  views  of  a  broad  cross  section  of  Army 
officers  with  varying  educational,  training,  and  experience 
backgrounds,  on  the  potential  tactical  advantages  of  improve¬ 
ments  in  mesoscale  weather  forecasting,  visits  were  made  to 
the  Army  organizations  indicated.  The  visits  were  preceded  by 
letters  (Appendix  B  is  a  copy  of  a  typical  letter)  from  the 
study  sponsor  (viz.,  the  Office  of  Research  and  Advanced  Tech¬ 
nology,  Director  of  Defense  Research  and  Engineering)  re¬ 
questing  Army  assistance. 

Discussions  during  the  visits  involved  55  Army  officers 
of  the  branches  indicated  and  12  USAF  and  civilian  meteorolo¬ 
gists  on  duty  with  the  Army.  Selection  of  discussion  partic¬ 
ipants  was  made  by  the  individual  organizations  visited. 


EXHIBIT  21 

POTENTIAL  PAYOFF  OF  IMPROVED  WEATHER  FORECASTING: 

MORE  EFFECTIVE  UTILIZATION  OF  WEAPONS  SYTEMS 
THROUGH  BETTER  PLANNING 

1.  FORECAST:  VISIBILITY  PREDICTED  TO  BE  1  KM  FOR  24  HR 

POSSIBLE  PAYOFF:  MOVE  TOWs  TO  AREA  WHERE  THEIR  3-KM 

RANGE  CAN  BE  UTILIZED  AND  REPLACE 
DRAGONs  WHOSE  RANGE  IS  1  KM 

2.  FORECAST:  VISIBILITY  SO  LOW  FORWARD  OBSERVER  CANNOT 

ADJUST  ARTILLERY  FIRE 

POSSIBLE  PAYOFF:  MOVE  ARTILLERY  TO  AREA  WITH  VISIBILITY 

ADEQUATE  FOR  OBSERVING  IMPACT  AREA 

3.  FORECAST:  RAIN  PREDICTED  OF  SUCH  AMOUNT/RATE  THAT 

TRAFFICABILITY  WILL  PRECLUDE  UTILIZING  TANKS 

POSSIBLE  PAYOFF:  USE  TANKS  IN  AREAS  WHERE  THEY  CAN 

MANEUVER 


BLUE 

ARMOR 


BLUE 

ARMOR 
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EXHIBIT  21 


To  initiate  discussions  with  Army  personnel  of  the  organi¬ 
zations  visited,  most  of  the  material  in  Exhibits  1  through  18 
was  presented.  As  a  means  of  stimulating  contributions  from 
the  Army  participants,  several  hypothetical  examples  of  potential 
payoff  of  improved  weather  forecasting  were  presented. 

While  the  substance  of  Army  contributions  is  contained  in 
Exhibits  22-26,  some  comments  on  these  specific  examples  are: 


Example  1.  Not  feasible  due  to  reasons  discussed  in 
Exhibit  23. 


Example  2.  If  a  forward  observer  cannot  adjust  artillery 
fire,  other  means,  e.g.,  radar,  would  be  used. 


Example  3.  Rather  than  using  Blue  tanks  in  an  area  where 
they  are  restricted  to  on-road  movement,  a 
commander  would  prefer  to  employ  less  mobile 
ATWs  (TOW  and  DRAGON)  against  a  potential  Red 
armor  threat,  which  would  also  be  denied  off¬ 
road  mobility  in  that  area.  However,  the 
variability  of  ground  relief,  soil  conditions, 
drainage,  vegetation,  and  recent  precipitation 
history  make  it  extremely  difficult  to  develop 
an  operationally  useful  model  for  estimating 
ground  mobility  characteristics  from  amounts 
and  rates  of  precipitation. 
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EXHIBIT  22:  DECISION  DETERMINANTS  IN 
TACTICAL  PUNNING  FOR  A  GIVEN  MISSION 


DECISION 

DETERMINANTS 

•  FORCES  AVAILABLE 

•  TERRAIN 

•  ENEMY  SITUATION 

SYSTEM  PERFORMANCE 
STRENGTH  &  DISPOSITION 
INTENTIONS 

•  WEATHER 


KNOWLEDGE  OF  DETERMINANTS 
MEAN  DECISIONS  ARE  MADE  UNDER 

CERTAINTY 


UNCERTAINTY 


MATRICES  FOR  DECISION  MAKING  UNDER  UNCERTAINTY 


ENEMY  SITUATION 


\  PERCEPTION 

\  OF  ENEMY 
\  SITUATION 
ADOPT  \ 

OR  REJF.CT\ 

COURSE  OF  \ 

ACTION  A)  \ 

ON  BASIS  OF  \ 
PERCEPTION  OF  \ 
ENEMY  SITUATION  \ 

ACCURATE 

NOT 

ACCURATE 

a 

ADOPT  A  ] 

CORRECT 

ERROR 

REJECT  Al 

ERROR 

CORRECT 

A,  -  HYPOTHETICAL 
COURSE  OF 
ACTION  WHICH 
IS  CONSIDERED 
PRUDENT  IF 
PERCEPTION  OF 
ENEMY  SITUATION 
IS  CORRECT 


WEATHER 


\  WX 

\  FORECAST 

ADOPT  \ 

OR  REJECT  \ 

COURSE  OF  \ 

ACTION  A2  \ 

ON  BASIS  OF  \ 

WX  FORECAST  \ 

ACCURATE 

NOT 

ACCURATE 

b 

ADOPT  A2 

CORRECT 

ERROR 

REJECT  A2 

ERROR 

CORRECT 

A2  -  HYPOTHETICAL 
COURSE  OF 
ACTION  WHICH 
IS  CONSIDERED 
PRUDENT  IF 
WX  FORECAST 
IS  CORRECT 


DECISION  MAKING  UNDER  UNCERTAINTY 

•  AVOID  RISK  OF  CATASTROPHIC  ERROR 

•  ACCEPT  RISK  OF  LOST  OPPORTUNITIES 

•  CREATE  HEDGES 
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EXHIBIT  22 


Decision  determinants  in  order  of  importance  for  tactical 
planning  are:  mission,  forces  available,  enemy  situation,  ter¬ 
rain,  and  weather.  For  a  given  mission,  terrain  can  usually  be 
observed  and  maps  can  convey  surface  inequalities  and  vegetation 
details.  Thus,  terrain  factors  are  essentially  certain  in  tac¬ 
tical  decision  making. 

While  a  commander  and  his  staff  should  have  a  good  knowledge 
of  the  performance  of  enemy  systems  (e.g.,  range  of  the  T-62 
tank  gun)  facing  them,  less  is  likely  to  be  known  of  enemy 
strength  and  disposition,  and  even  less  of  enemy  intentions. 

Thus,  tactical  decision  making  is  done  with  some  uncertainty 
of  enemy  situation. 

Since  forecast  weather  is  also  an  uncertain  factor,  tacti¬ 
cal  planning  decisions  are  made  with  uncertainty  of  that  deter- 
mi nant . 

Occurrences  of  bad  weather  (as  defined  in  Exhibit  8)  such 
as  low  visibility,  low  ceilings,  heavy  precipitation,  and  high 
winds  are,  except  in  certain  locations  and  seasons,  relatively 
infrequent  weather  events  which  restrict  weapon  systems  opera¬ 
tions  without  endangering  personnel  and  equipment  if  prudent 
operational  limitations  are  observed.  There  is  a  set  of  even 
less  frequent  weather  events,  viz.,  thunderstorms,  hail  storms, 
cyclones,  tornadoes,  etc.,  which  not  only  restrict  and/or  tem¬ 
porarily  preclude  weapon  systems  operations,  but  require  mea- 
sures--such  as  evacuation,  sheltering,  and  tie-down--to  reduce 
the  exposure  of  personnel  and  equipment  to  very  high  winds, 
flying  debris,  hail,  etc.  In  a  combat  environment,  however. 


prudent  measures  to  safeguard  personnel  and  equipment  from  the 
effects  of  severe  weather  would  not  be  undertaken  without  con¬ 
sideration  of  the  enemy  situation. 

The  relative  ordering  of  the  importance  of  tactical  decision 
determinants  does  not  mean  that  weather  circumstances  cannot  at 
times  create  operational  imperatives  for  a  tactical  command 
(for  example,  relocation  of  helicopters  from  bases  expected  to 
soon  be  exposed  to  severe  weather-- very  high  winds  or  heavy 
precipitation). 

While  the  form  of  the  responses  of  the  many  Army  officers 
varied  on  how  tactical  decisions  are  made  under  uncertainty, 
the  essence  of  the  responses  encompassed  classical  rules  for 
decision  making  under  uncertainty:  (1)  avoid  risks  of  cata¬ 
strophic  errors  (i.e.,  do  not  plan  actions  whose  outcome  could 
result  in  failure  to  complete  mission,  or  to  achieve  objectives, 
or  in  unacceptable  losses);  (2)  accept  risk  of  lost  opportunities 
(to  avoid  unacceptable  outcomes);  and  (3)  create  hedges  (i.e., 
alternative  courses  of  action). 

As  an  example,  suppose  a  commander  decides  that  for  his  next 
day's  operations  the  destruction  of  a  certain  target  is  critical 
to  the  success  of  his  mission  and  that  using  aircraft  is  pre¬ 
ferred  to  artillery  from  force  economy  considerations.  And  fur¬ 
ther  suppose  that  the  weather  forecaster  and  the  commander  are 
99/100  sure  that  early  morning  weather  will  be  suitable  for  an 
air  strike.  If  that  target  is  really  critical  (its  survival 
means  mission  failure  or  unacceptably  high  losses),  the  prudent 
commander  plans  an  air  strike  but  also  hedges  by  moving  some 
artillery  weapons  to  positions  from  which  the  target  can  be 
bombarded  (this  movement  is  an  alternative  course  of  action, 
which  may  preclude  using  those  weapons  against  other  targets 
at  that  time)  if  the  weather  unexpectedly  precludes  attack  by 
air. 
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While  that  is  an  example  relating  prudent  decision  making 
to  a  very  reliable  weather  forecast,  command  prudence  is  valu¬ 
able  also  with  forecasts  of  low  reliability.  For  example, 
suppose  a  weather  forecaster  and  a  helicopter  unit  commander 
are  1/100  sure  that  during  the  night  following  the  current  day's 
operations,  the  local  base  will  experience  high  winds  which  could 
cause  substantial  helicopter  damage  if  the  rotor  blades  are  left 
in  their  normal  extended  position.  To  avoid  risk  of  damage,  the 
prudent  commander  would  have  (1)  the  crews,  before  securing,  take 
the  few  minutes  required  to  fold  or  tie  down  the  rotor  blades 
of  all  helicopters  other  than  one  or  two  which  might  remain  on 
standby  alert  during  the  night  and  (2)  personnel  ready  to  fold 
blades  on  the  standby  aircraft  at  the  first  sign  of  increased 
wind  velocity. 
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EXHIBIT  23:  BATTLEFIELD  DECISION  MAKING 

LATERAL  UNIT  DEPLOYMENTS  TO  TAKE  ADVANTAGE  OF  WX  FORE¬ 
CASTS  ARE  NOT  FEASIBLE  BECAUSE  OF  SEVERAL  FACTORS: 

•  TRANSPORTATION 

•  FIRE  PLAN  INTEGRATION 

•  PSYCHOLOGY 

•  LOGISTICAL  SUPPORT 

COMBAT  SYSTEMS  ARE  SUFFICIENTLY  WEATHER-ADAPTABLE 
THAT  WEATHER  FORECASTS  ARE  CHARACTERISTICALLY  NOT 
CRITICAL  CONSIDERATIONS 

PERCEPTION  OF  ENEMY  SITUATION  AND  TERRAIN  REALITIES 
ARE  DOMINANT  CONSIDERATIONS  IN  TACTICAL  PLANNING 

MIGHT  ADJUST  INDIVIDUAL  POSITIONS  BUT  NOT  REDEPLOY 
WHOLE  UNITS 

DEFICIENCIES  IN  CURRENT  WX  INFORMATION,  NOT  IN  WX 
FORECASTS,  ARE  THE  MAJOR  METEOROLOGICAL  CONCERN 


78 


EXHIBIT  23 

Lateral  unit  deployments,  such  as  described  in  the  first 
example  of  Exhibit  21,  to  take  advantage  of  a  weather  forecast 
are  not  feasible  due  to  several  considerations. 

T ransportati on.  Additional  transport  equipment  would  be 
required  to  facilitate  increased  lateral  movement  (by  helicopter 
and  truck  as  well  as  on  foot).  While  the  increase  in  equipment 
is  not  itself  a  compelling  deterrent,  the  movements  near  the 
forward  edge  of  the  battle  area  (FEBA)  would  occur  in  the 
already  most  congested  area  of  operations. 

Fire  Plan  Integration.  A  unit  in  an  area  A  has  had  its 
position  and  firing  zones  assigned  in  an  integrated  fire  plan 
for  A.  Redeploying  a  unit  from  A  to  another  area  B  requires 
a  modification  of  the  B  fire  plan  to  integrate  the  fire  capa¬ 
bilities  of  the  new  unit. 

Psychology.  Disruption  of  organizational  integrity  in  A 
by  redeploying  a  unit  to  another  organization  in  B  involves 
the  units  of  the  latter  organization  relying  on,  and  being 
relied  on  by,  the  new  unit  for  mutual  fire  support.  Such  re¬ 
liance  is  greatly  fostered  by  personal  relationships  and  con¬ 
fidences  that  accrue  from  stability  of  organizations  in  A  and 
in  B . 

Logistical  Support.  Exchanging  units,  such  as  in  the  first 
example  of  Exhibit  21,  would  require  lead  time  to  change  pre¬ 
viously  planned  flows  of  unique  supplies  (e.g.,  TOW  and  DRAGON 
missiles  in  the  example)  to  logistical  organizations  responsible 
for  supporting  new  forward  units,  thus  requiring  additional 
flexibility  of  an  already  busy  logistics  system. 
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These  considerations  make  it  impracticable  to  deploy 
ground-based  weapon  systems  on  the  basis  of  weather  forecasts 
unless  the  forecasts  are  very  reliable  and  unless  the  weather 
is  expected  to  remain  relatively  steady  long  enough  to  make 
such  weather-forecast-induced  deployments  worthwhile. 

The  total  effect  of  the  above  considerations  is  to  make 
experienced  Army  officers  feel  that  the  reliability  improve¬ 
ments  projected  in  Exhibit  16  for  1985  weather  forecasts  will 
not  influence  battlefield  decision  making  nor  provide  oppor¬ 
tunities  to  utilize  forces  differently  than  they  would  today. 

A  recurring  observation  in  discussions  with  Army  officers 
of  all  branches  addresses  the  adaptability  of  systems  (person¬ 
nel  and  hardware)  to  weather:  the  Army's  combat  systems  can 
characteristically  function  over  a  wide  range  of  weather  con¬ 
ditions  so  that  weather  forecasts  are  usually  not  critical  con¬ 
siderations  for  tactical  decisions  on  the  battlefield.  When 
forecast  weather  is  expected  to  limit  system  performance,  tac¬ 
tical  decision  makers  still  give  primary  importance  to  their 
perception  of  enemy  situation  and  to  realities  of  the  terrain. 
Improving  current  weather  information  appears  to  be  of  much 
greater  concern  than  are  potential  weather  forecasting  im¬ 
provements  . a 

Even  with  the  improved  forecast  reliabilities,  tactical 
planning  will  continue  to  be  dominated  by  considerations  of 
enemy  situation  (as  perceived)  and  the  terrain.  While  a  com¬ 
mander  may  adjust  individual  fire  positions  because  of  weather 
(rather  than  redeploy  a  whole  unit),  such  adjustments  are  local 
and  would  be  based  on  current  weather  trends  rather  than  on 
weather  forecasts  (e.g.,  as  visibility  decreases,  say,  from  3 
km  to  1  km,  to  move  TOW  ATWs  in  an  area  forward  to  positions 
which  offer  improved  engagement  potential). 

aThis  concern  is  especially  acute  to  chemical  staff  officers 
who  appear  to  be  without  any  weather  data  relevant  to  their 
interests . 
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EXHIBIT  24 


The  sketch  shows  typical  distances3  over  which  control  is 
exercised  by  various  Army  command  echelons  and  their  typical 
planning-preparation  times. 

The  planning-preparation  times  represent  times  typically 
required  by  the  command  echelons  indicated  for  operations  in¬ 
volving  the  whole  command  or  operations  in  which  the  command 
has  the  initiative.  Obviously,  planning-preparation  times 
could  be  shorter  when  a  command  is  planning  the  utilization 
of  only  part  of  its  force  (e.g.,  division  may  be  maintaining 
control  of  division  artillery  while  putting  all  other  division 
combat  elements  under  control  of  its  brigades)  or  when  the 
enemy  situation  requires  quick  response  (e.g.,  to  an  unexpected 
attack ) . 


aUnit  depths  are  from  Army  Field  Manual  FM  100-5,  Operations. 
Corps  area  width  is  estimated  range  of  distances  of  Corps 
responsibility  for  defensive  and  offensive  operations.  In 
some  defensive  scenarios.  Corps  frontage  may  exceed  200  km. 
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EXHIBIT  25:  WX  FORECASTING,  PLANNING,  AND  COMMAND  LEVELS 

LOWER  COMMAND  LEVELS  (BRIGADE,  BATTALION,  COMPANY,  PLATOON) 

•  EXECUTE  HIGHER  LEVEL  PLANS 

•  LIMITED  FLEXIBILITY 

HIGHER  COMMAND  LEVELS  (DIVISION  &  CORPS) 

•  MUST  ENLARGE  TIME  WINDOWS  FOR  LOWER  ECHELONS 

ACHIEVING  OBJECTIVES  IF  THE  LOWER  COMMAND 
LEVELS  ARE  TO  TAKE  ADVANTAGE  OF  WX 
FORECASTS 

•  ENLARGING  TIME  WINDOWS  IS  NOT  PRACTICABLE 

BECAUSE  LOWER  ECHELON  OBJECTIVES  ARE 
MUTUALLY  SUPPORTING 

BIASED  FORECASTS  ARE  OBVIOUSLY  WELCOMED— BUT  LITTLE 
ADVANTAGE  TO  HIGHER  COMMAND  LEVELS  IS  APPARENT 
SINCE  DURATION  OF  RELIABLE  FORECASTS  IS  SO  MUCH 
LESS  THAN  TIME  FOR  TACTICAL  PLANNING-PREPARATION 


f 


EXHIBIT  25 


Exhibit  22  identified  tactical  decision  determinants  for 
any  command  level.  Exhibit  24  distinguished  the  various  com¬ 
mand  levels  by  control  span  and  planning-preparation  time. 

This  exhibit  summarizes  the  nature  of  tactical  planning  and 
the  impact  of  weather  forecasting  at  those  command  levels. 

Tactical  planning  involves  (1)  development  of  a  scheme 
of  maneuver,  (2)  fire  planning,  and  (3)  logistical  planning. 
While  each  command  level  develops  a  scheme  of  maneuver  to 
achieve  its  objective,  staff  planners  are  increasingly  con¬ 
cerned  with  fire  planning  at  the  lower  command  levels  (at 
platoon  and  company  levels  almost  all  planning  is  fire  plan¬ 
ning)  and  logistical  planning  at  the  higher  command  levels. 

Characteristically,  lower  level  commands  carry  out,  and 
develop  their  own  plans  in  accordance  with,  higher  level  com¬ 
mand  plans  which  specify  mission,  objectives,  and  times.  Thus, 
lower  level  commands  are  constrained  in  their  planning  flexi¬ 
bility.  If  they  are  to  have  greater  flexibility  to  react  to 
weather  forecasts,  their  orders  from  higher  level  commands 
must  allow  greater  flexibility  in  the  times  for  executing 
assigned  missions  or  achieving  their  objectives.  But  because 
the  missions  and  objectives  of  lower  command  echelons  are  char¬ 
acteristically  mutually  supporting,  it  is  not  really  practica¬ 
ble  for  the  higher  commands  to  provide  more  flexibility  in  tim¬ 
ing.  (Operations  of  a  football  team  are  a  good  analogy:  play 
execution  requires  close-knit  timing  for  carrying  out  many  in¬ 
dividual,  but  coordinated,  assignments.) 
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Even  a  biased  weather  forecast  (i.e.,  a  very  reliable  one 
for  a  weather  event,  say,  in  6  hours)  for  a  mesoscale  area  of 

o 

one  unit  (say,  a  battalion  in  a  5  x  5  km  area )  is  unlikely  to 
influence  the  planning  or  actions  of  that  unit  since  its  mis¬ 
sion  and  objective  and  the  times  for  their  execution/achieve¬ 
ment  are  already  set  by  a  higher  level  command  (say,  a  division 
with  24  hours  for  planning  and  preparation)  along  with  missions, 
objectives,  and  times  for  its  other  units  in  different  mesoscale- 
sized  areas. 
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EXHIBIT  26:  COMPARISON  OF  WX  FORECAST 
DURATION  AND  PLANNING-PREPARATION  TIME 


(EXAMPLE:  VISIBILITY  FORECAST  TO  BE<1  MILE) 


RELIABILITY 

OF 

FORECAST 


TIME,  DAYS 


LEVEL 

OF 

COMMAND 


[MWI  ~  RANGE  OF  TYPICAL  PLANNING-PREPARATION  TIMES  FOR 
VARIOUS  COMMAND  LEVELS 


EXHIBIT  26 


Although  visibility  less  than  one  mile  is  the  forecast 
example  to  illustrate  the  comparison  of  forecast  duration  and 
pi anning-preparation  time  shown,  the  following  discussion 
should  be  equally  valid  if  other  bad  weather  events  (e.g., 
those  in  Exhibit  17)  were  used. 

The  forecast  reliability  data  (Exhibit  16)  are  extrapolated 
to  several  days  to  compare  forecast  duration  and  reliability  decay 
with  typical  maximum  amounts  of  time  various  commands  require  for 
planning  and  preparation.  The  ranges  of  planning-preparation  times 
shown  are  based  on  discussions  with  many  experienced  Army  officers 
and  on  in f orma t i on  requirements  outlined  in  Ref.  9.  Of  course, 
only  the  0-1  day  portion  of  the  continuum  of  forecast  reliability 
represents  the  time  scale  for  mesoscale  weather  forecasting. 

Optimistic  projections  of  1985  reliability  are  high  enough 
to  be  potentially  useful  to  only  the  lowest  command  echelons. 
Exhibit  25,  however,  indicates  that  these  lowest  echelons  have 
minimal  flexibility  to  react  to  weather  forecasts;  and  Exhibit 
23  indicates  that  tactical  operators  consider  the  additional 
difficulties  and  costs  of  lateral  redeployment  of  units  as  out¬ 
weighing  the  potential  operational  advantages  even  when  fore¬ 
cast  reliability  is  high. 

Biased  forecasts  are  obviously  potentially  more  useful 
than  average  forecasts  but,  just  as  obviously,  there  is  an  in¬ 
verse  relationship  between  the  standard  (i.e.,  threshold  level 
of  forecaster  confidence)  for  forecast  reliability  and  the  frac¬ 
tion  of  forecasts  which  meet  that  standard.  And  (from  Exhibit 
25  discussions)  missions,  objectives,  and  execute/achieve  times 
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established  by  higher  level  commands  are  tactical  imperatives 
allowing  little  flexibility  for  the  lower  command  levels,  which 
are  also  more  strongly  influenced  by  their  perception  of  enemy 
situation  and  by  terrain  realities  than  by  reliable,  near-future 
weather  forecasts. 

As  indicated  in  the  Exhibit  16  discussion,  improvements 
in  average  mesoscale  weather  forecasting  may  not  significantly 
impact  the  biased  forecasts,  which  are  already  quite  reliable 
today. 


EXHIBIT  27:  SUMMARY  OF  FINDINGS 

1.  BATTLEFIELD  TACTICAL  PLANNING  IS  PRIMARILY  DONE  AT  CORPS 
AND  DIVISION  LEVELS. 

2.  AT  ANY  LEVEL  OF  COMMAND,  MISSION,  FORCES  AVAILABLE, 

ENEMY  SITUATION,  AND  TERRAIN  ARE  DOMINANT  CONSID¬ 
ERATIONS  IN  TACTICAL  PLANNING. 

3.  AT  LOWER  COMMAND  LEVELS  (VIZ.,  BATTALION,  COMPANY,  AND 
PLATOON)  CONSISTENT  WITH  MESOSCALE  GEOGRAPHIC  AND  TIME 
DIMENSIONS,  TACTICAL  DECISIONS  ARE  INFLUENCED  BY  MISSION, 
ENEMY  SITUATION,  TERRAIN,  AND  WEATHER  IN  THAT  ORDER. 

4.  THE  MUTUAL-SUPPORTING  NATURE  OF  MISSIONS  AND  OBJECTIVES 
OF  LOWER  COMMAND  LEVELS  LIMITS  THEIR  FLEXIBILITY  TO 
REACT  TO  WEATHER  FORECASTS. 

5.  RELIABILITY  OF  OPTIMISTIC  NEAR-TERM  (1985)  MESOSCALE 
FORECASTS  OF  WEATHER,  WHICH  LIMIT  SYSTEM  PERFORMANCE, 
APPEARS  TO  BE  INSUFFICIENTLY  BETTER  THAN  RELIABILITY 
OF  CURRENT  (1977)  FORECASTS  TO  AFFECT  BATTLEFIELD 
OPERATIONS. 

6.  IMPROVEMENTS  IN  CURRENT  WX  INFORMATION  RATHER  THAN  IN 
WX  FORECASTING  MAY  BE  MORE  IMPORTANT  TO  BATTLEFIELD 
OPERATIONS. 
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EXHIBIT  28:  CONCLUSIONS 


1.  AN  OPTIMISTIC  IMPROVEMENT  IN  MESOSCALE  WEATHER 
FORECASTING  CAPABILITY  PROJECTED  FOR  1985  APPEARS 
TO  PROVIDE  NO  ADDITIONAL  UTILITY  FOR  ARMY  FORCES, 

2.  A  PHASE  2  EFFORT  TO  CONSIDER  CAPABILITY-COST 
TRADEOFFS  FOR  A  MWF  SYSTEM  FOR  ARMY  OPERATIONS 
IS  NOT  WARRANTED. 

3.  IF  A  PHASE  2  EFFORT  IS  UNDERTAKEN,  CONSIDERATION 
SHOULD  BE  GIVEN  TO  ASSESSING  THE  INFLUENCE  OF  WX 
INFORMATION,  FOR  USE  IN  CURRENT  OPERATIONS  AS  WELL 
AS  FOR  PREDICTING  INPUTS  FOR  PLANNING,  ON  ARMY 
TACTICAL  OPERATIONS. 
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TASK  ORDER 
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DEFENSE  ADVANCED  RESEARCH  PROJECTS  AGENCY 

1400  WILSON  BOULEVARD 
ARLINGTON,  VIRGINIA  22209 


TASK  ORDER  FOR  WORK  TO  BE  PERFORMED 
BY 

INSTITUTE  FOR  DEFENSE  ANALYSES 


TASK  ORDER  T-135 


DATE: 


You  are  hereby  requested  to  undertake  the  following  task: 


1.  TITLE:  Mesoscale  Weather  Forecasting 


2.  OBJECTIVE:  The  objective  of  this  task  is  to  evaluate  potential 
mesoscale  weather  forecasting  systems  —  including  components  related 
to  data  collection,  processing  and  communication  functions  —  for  support 
of  tactical  military  operations  in  the  mid-1980s,  "Mesoscale"  implies 
regional  forecasting  to  resolutions  of,  for  example,  20  km,  as  opposed 
to  "macroscale"  forecasting  whose  typical  resolution  is  on  the  order  of 
400  km. 


3.  TECHNICAL  SCOFE:  An  assessment  will  be  node  of  likely  technical 
advances  in  components  of  mesoscale  weather  forecasting  systems  for  the 
mid-1980s.  Appropriate  combinations  of  components  forming  alternative 
mesoscale  systems  will  be  evaluated  with  respect  to  (1)  potential  imureve- 
ments  in  tactical  operational  capability  that  technology  advances  might 
provide  and  (2)  marginal  costs,  procurement  and  support,  of  advanced 
mesoscale  systems  over  similar  costs  of  current  forecasting  systems. 

The  task  is  to  be  accomplished  in  two  phases,  with  a  review  prior  to 
phase  2  lo  determine,  whether  phase  1  analyses  suggest  continuation  is 
worthwhile.  The  phase  1/review/phase  2  division  of  the  task  is  as 
follows : 

Phase  1:  Identify  parameters  useful  in  describing  weather  prediction 
precision,  e.g.,  spatial  resolution  of  predicted  weather,  duration  of 
prediction,  and  lead  time  until  prediction  is  operative.  Determine  the 
highest  precision  mesoscale  weather  forecasting  system  that  appears 
technically  feasible  for  the  mid-1980s.  Identify  ways  and,  if  possible 
develop  some  measurable  indicators  that  relate  tactical  operational 
capability  tc  weather  forecasting  precision. 

Review:  If  phase  1  analyses  indicate  potential  payoffs  exist  for 

advanced  mesoscale  forecasting,  phase  2  analyses  would  be  conducted. 

If  potential  increases  ir.  operational  capability  with  the  highest 
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precision  niesoscale  system  are  not  expected,  phase  1  results  will  be 
presented  in  a  report  which  summarizes  the  significant  findings  and 
the  methods  of  analysis  used. 


Phase  2:  Complete  mesoscale  weather  forecasting  analysis  to 
include  systems  offering  lower  levels  of  prediction  precision.  Relate 
potential  increases  in  operational  capability  to  mesoscale  system 
options.  Estimate  costs,  acquisition  and  support,  of  projected  mesoscale 
system  options  and  current  weather  forecasting  systems.  Results  of 
the  entire  study,  phases  1  and  2,  will  be  presented  in  a  report  which 
will  summarize  the  significant  findings  and  the  methods  of  analysis 
used. 

The  technical  assessment  of  mesoscale  systems  should  include  worldwide 
applications.  Costs  and  operational  capability  estimates  should  apply 
to  a  major  theater,  e.g.,  Central  Europe. 

4.  SCHEDULE :  Work  on  this  task  shall  commence  upon  task  order  acceptance. 
Phase  1  will  be  completed  by  1  July  1977.  If  the  task  is  not  continued 
into  phase  2,  a  draft  phase  1  report  will  be  delivered  by  1  September  1977. 
Phase  2,  if  undertaken,  will  be  completed  and  a  draft  report  of  work  on 
the  entire  task  will  be  delivered  by  1  April  1978. 

5.  COORDINATION :  Coordination  with  personnel  of  the  Navy,  Air  Force, 
and  Army  Weather  Service  Programs,  the  Defense  Meterological  Satellite 
Program,  the  Federal  Aviation  Administration,  the  National  Oceanographic 
and  Atmospheric  Administration,  and  various  operational  planning  staffs 
of  the  military  Services  will  be  necessary  during  the  period  of  study. 

6.  TECHNICAL  COGNIZANCE;  Assistant  Director  (Environmental  and  Life 
Sciences),  ODDR&E,  who  will  decide  on  phase  2  continuation. 

7.  SCALE  OF  EFFORT:  Two  (2)  man-years,  including  consultants  as 
required  by  IDA,  for  phase  1.  Two  (2)  man-years,  including  consultants 
as  required  by  IDA,  for  phase  2.  Not  more  than  three  (3)  man-months  of 
effort  will  be  expended  prior  to  .1  October  1976. 

8.  REPORT  DISTRIBUTION  AND  CONTROL:  The  Assistant  Director  (Environmental 
and  Life  Sciences),  ODDR&E,  will  determine  the  number  of  copies  of  reports 
and  their  distribution.  A  "need- to-know"  is  hereby  established  in 
connection  with  this  task  and  access  to  classified  documents  and  publications, 
security  clearances  and  the  like,  necessary  to  complete  the  task,  will  be 
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ODDR&E  LETTER  TO  ARMY  WAR  COLLEGE 


2  3  JUN  1977 


Major  General  Do  Witt  C.  Smith,  Jr. 

Commandant 

U.  S.  Army  War  College 

Carlisle  Barracks,  PA  17013 

Dear  General  Smithi 

The  Institute  for  Defence  Analyses  (IDA)  Is  evaluating  for  this  office 
the  potential  tactical  utility  that  might  be  derived  by  extending 
weather  forecasting  capabilities  from  the  current  coarse  resolution 
of  hundreds  of  kilometers  to  finer,  mecoscale  roaolutlona  of  the 
order  of  a  few  kilometers.  Through  consultation  with  the  scientific 
community,  IDA  has  developed  a  best  estimate  of  the  expected 
hnprovemont  in  weather  forecasting  through  the  mld-BOs.  Y»rc  aro 
now  seeking  your  help  to  measure  the  benefits  of  such  improvements. 
Because  weather  forecasts  are  only  one  of  several  factors  considered 
in  tactical  planning,  wo  need  the  pragmatic  view  of  your  faculty  and 
students  to  identify  specific  potential  tactical  advantages  that  might 
result  from  improvements  Ln  mosoucule  weather  forecasting. 

'I he  attached  Information  presents  the  problem  In  detail,  and  cote 
forth  tho  questions  to  bo  answered.  While  your  assistance  Ib  moot 
Important  for  this  task,  I  would  like  to  minimise  the  burden  of  thlo 
request  by  asking  for  a  point  of  contact  with  whom  tho  IDA  people 
can  arrange  a  visit  to  dlscuso  tho  mattora  indicated  and  to  receive 
any  response  you  can  provide.  Attachment  4  contains  the  names, 
addresses,  and  telephone  numbera  of  the  IDA  personnel  partici¬ 
pating  in  tills  study.  Your  point  of  contact  can  identify  himself 
merely  by  coiling  any  one  of  the  IDA  people. 

Thank  you  for  your  acoiotnuco. 


Sincerely, 


(Signed) 


Donald  I.  Carter /a. 


IX' 


John  L.  Allen 
Deputy  Director 
(Research  nud  Advanced 
Technology) 


Attachment!) 


B-3 


DISTRIBUTION  LIST:  Weather  Evaluation  Study 

Coirrmandcr,  U.  S.  Army  Intelligence  Center  and  School,  Ft.  Huachuca,  AZ 

Commandant,  U.  S.  Army  War  College,  Carlisle  Barracks,  FA 

Commanding  General,  U.  S.  Army  Aviation  Center,  Fort  Rucker,  AL 

Commandant,  U.  S.  Army  Command  and  General  Staff  College, 

Fort  Leavenworth,  KS 

Commandant,  U,  S.  Army  Armor  School,  Fort  Knox,  KY 
Commandant,  U.  S.  Army  Engineer  School,  Fort  Belvoir,  VA 
Commandant,  U.  S.  Army  Infantry  School,  Fort  Benning,  GA 
Commandant,  U.  S.  Army  Field  Artillery  School,  Fort  Sill,  OK 
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Attachment  1 


Statement  of  Problems 

Problem:  Given  the  expectation  that  the  accuracy  of  weather 
forecasting  will  improve,  will  improved  weather  forecasting  permit 
better  utilization  of  available  forces,  principally  in  a  postulated 
European  theatre  in  19B5? 

The  following  are  constraints  on  this  study: 

1.  It  is  focused  on  potential  Army  operations  in  the  European 
theatre  during  the  mid-1980s, 

2.  It  considers  only  weather  forecasting  for  short-range  tactic.nl 
planning;  i.  e.  ,  it  excludes  either  climatology  (for  long-range 
strategic  planning)  or  meteorological  observations  for  "combat 
information"  (e.  g.  ,  using  current  or  recent  wind  observations 
for  gun  aiming). 

3.  It  considers  how  improvements  in  mesoscale  weather  fore¬ 
casting  might  improve  tactical  capabilities  for  day-to-day 
operations,  in  contrast  with  the  infrequent  epic  events  such 
as  the  Normandy  invasion  during  World  War  II. 

4.  It  assumes  that  improved  weather  forecasting  is  unlikely  to 
cause  changes  in  force  structure.  This  assumption  implies 
that  we  will,  for  example,  continue  to  develop  and  procure 
"all-weather"  systems  because  their  usefulness  is  fairly 
certain  even  without  considering  specifics  of  time  and 
geography  for  their  employment. 

To  provide  initial  stimulus  for  your  thinking.  Attachment  2  contains 
some  examples  of  potential  advantages  to  tactical  planners.  They 
have  been  oversimplified  by  assuming  that  predictions  of  weather 
phenomena  are  100  percent  correct  and  omitting  many  details  pertinent 
to  any  tactical  scenario.  It  is  at  this  point  that  we  seek  your 
assistance  to  interject  real  world  specifics.  You  may  recall  scenarios 
or  use  stylized  scenarios  (in  current  course  work)  which  enables  you 
to  identify  specific  tactical  advantages  that  might  be  realized  with 
improved  weather  forecasting  capability. 

While  there  arc  numerous  environmental  considerations  related  to 
tactical  operations,  our  attention  is  focused  on  a  few  primary  param¬ 
eters:  (1)  visibility  and  ceiling,  which  affect  target  acquisition  and 
weapon  delivery,  and  (2)  precipitation,  which  can  affect  trafficability 
and,  hence,  ground  mobility.  We  are,  therefore,  including  our 
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current  (197 /)  and  projected  (1985)  forecast  capabilities  for  these 
parameters  in  Attachment  3.  Also  included  are  definitions  of 
parameters  (viz.  ,  spatial  resolution  and  lead  time)  which  appear 
important  for  utilization  of  weather  forecasts.  Based  upon  the 
prediction  precisions  (probability  of  correct  forecast)  in  Attachment  3, 
would  you  identify  possible  ways  forces  (any  echelon  from  battalion  to 
corps)  might  be  used  more  effectively  or  efficiently.  Of  course,  we 
are  especially  interested  in  whether  the  set  of  data  for  1985  provides  a 
possible  basis  for  improved  force  utilization. 
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Attach  lent  2 


Examples  of  potential  payoff  of  improved  weather  forecasting  for 
more,  effective  utilization  of  weapon  systems  through  better  planning. 

1.  Force  a  st:  Visibility  in  an  area  is  predicted  to  be  1  km  or  less 
for  24  hours. 


Possible  Payoff:  Move  TOW  systems  to  an  adjacent  area  where 
their  3-lun.  range  might  be  better  utilized  and  replace  the  TOW  ATW 
force  (or  part  of  it)  with  DRAGON  teams  from  the  area  of  predicted 
better  visibility. 

2.  Forecast:  Visibility  so  low  that  a  forward  observer  will  not  be 
able  to  adjust  artillery  fire  for  24  hours. 

Possible  Payoff:  Move  artillery  to  an  area  with  visibility,  adequate 
for  observing  area  of  intended  impact, 

3.  Forecast:  Rain  of  such  amount  and  rate  that  t rafficabilitv  will 

-  2>  j 

preclude  tank  maneuvering  off-roads  in  a  100  km  area  for  24  hours. 

Possible  Payoff:  Assuming  friendly  force  is  defensively-oriented, 
deploy  tanks  to  nearby  area  with  adequate  trafficability  rather  than 
assign  them  a  static  defensi\-e  role. 

4.  Forecast:  Ceiling  and/or  visibility  too  low  for  helicopter  in  an 
area  for  24  hours. 

Possible  Payoff:  Plan  operations  for  which  helicopters,  attack 
or  transport,  tire  critical  in  other  areas. 

Possible  Problems:  While  the  last  example  of  better  planning  of 
helicopter  utilization  to  take  advantage  of  weather  forecasts  is  quite 
obvious  and  surely  considered  today,  certain  problems  in  connection 
with  lateral  shifting  of  ground-based  systems  and  units  need 
evaluation:  (1)  additional  dermoids  on  transportation  resources  (ground 
based  and  transport  helicopter)  and  (2)  additional  coordination  of  shiftoc 
systems  (weapons  plus  operators)  with  adjacent  and  supporting  units. 
Also,  the  probabilities  of  phenomena  predictions  being  correct  beyond 
a  few  hours  may  be  too  low  to  provide  a  reliable  basis  for  force 
movement  considerations. 
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Attachment  3 


Utilization  (lor  planning)  and  precision  (probability  forecast  will  be 
correct)  of  visibility,  ceiling#  and  precipitation  predictions. 

Sp.aial  Resolution:  Expected  to  be  4  ion  x  4  km  for  1977  and  1985. 

It  means  that  the  visibility,  ceiling,  or  precipitation  phenomenon, 
will  occur  in  part  (from  small  to  large)  or  all  of  a  4  km  x  4  1cm  grid 
square  with  probabilities  tabulated  on  the  following  page.  A  whole 
theater  could  be  divided  into  a  collection  of  similarly-sized  grid 
squares  for  weather  forecasting  purposes. 

Lead  Time:  Time  available  for  tactical  planning  (c.  g.  ,  force  move¬ 
ment)  to  take  advantage  of  prediction  of  weather  phenomenon. 

Example:  Visibility  is  forecast  to  be  less  than  0.  8  km  using  1988 
state-of-the  art 


Probability 
Forecast 
will  be 
Correct 


6  12 


Lead  Time  until  Forecast  is  Operative,  Hours5 


*  Thus,  for  example,  a  0.  61  probability  that  actual  visibility  in  (part 
or  all  of)  a  4  km  x  4  km  grid  square  will  be  less  than  0.  8  km  provides 
no  time  to  move  forces  to  take  advantage  of  the  forecast  for  the  next 
6-hour  period;  a  12-hour  lead  time,  during  which  forces  might  be 
moved,  provides  0.  44- probability  of  correct  prediction  for  the  12-24  hour 
period;  and  a  12-hour  lead  time  provides  about  0.  42  probability  of 
correct  visibility  prediction  for  the  12-36  hour  period. 


f 


correct  number  of  forecasts/number  of  observations] 


P  refers  to  the  forecast  rainfall  in  a  24-hr  period 
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Identification  of  personnel  involved  with  mesoscale  forecasting  study. 

a 


Mr, 

Murray  Kamrass 

Institute  for  Defense  Analyses 
Arlington,  Virginia  22202 

558-1667 

Mr. 

Henry  Hidalgo 

same  as 

above 

558-1644* 

Mr. 

Jolvn  Metzko 

same  as 

^lbove 

558-  1652* 

£ 

Area  code  is  703 
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APPENDIX  C 
MESOMETEOROLOGY 

Subdivision  of  Mesoscaie  Regime  C-4 

Mesoscale  Weather  Forecasting  for  Tactical  C-5 

Operations 

Vertical  Extent  of  Meso-B  and  Meso-v  Phenomena  C-5 
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MESOMETEOROLOGY 

It  is  common  knowledge  that  weather  is  characterized  by  tran¬ 
sient  developments  of  atmospheric  events,  which  can  take  place  in  a 
very  wide  range  of  space  and  time  scales.  A  graphic  illustration 
of  the  range  of  s^ace  scales  Is  given  by  weather  satellite  pictures 
covering  a  hemisphere.  These  pictures  show,  for  example,  the 
horizontal  macroscale  domain  of  atmospheric  events  such  as  the 
global  distribution  of  clouds.  The  horizontal  macroscale  domain  has 
been  defined  by  dimensions  (d)  that  are  larger  than  2000  km  (Ref.  2) 
i.e.,  by  2000  s  d  s  40,000  km,  where  the  upper  value  of  this  range 
is  given  by  the  circumference  of  the  earth.  Typical  examples  of 
macroscale  atmospheric  phenomena  are  given  by  (a)  planetary  waves, 
such  as  standing  waves,  ultralong  waves,  and  tidal  waves,  which  have 
wavelengths  longer  than  10,000  km,  and  (b)  baroclinic  waves  (where 
potential  energy  can  be  converted  into  kinetic  energy)  with  wave¬ 
lengths  (X)  in  the  range  2000  <  X  <  10,000  km  (Ref.  2). 

Satellite  pictures  can  also  show  the  horizontal  scale  of  meso- 
scale  phenomena  such  as  hurricanes,  fronts,  disturbances  induced  by 
mountains  and  lakes,  squall  lines  (i.e,,  moving  lines  of  thunder¬ 
storms),  and  cloud  clusters.  Other  types  of  mesoscale  phenomena, 
not  always  visible  in  satellite  pictures,  are  individual  thunder¬ 
storms,  clear  air  turbulence,  urban  effects,  etc.  The  horizontal 
mesoscale  domain  'has  been  defined  by  dimensions  in  the  range  2  s  d 
£  2000  km  (Ref.  2),  i.e.,  an  intermediate  scale  regime  bounded  by 
the  macroscale  (d  a  2000  km)  and  microscale  (d  s  2  km)  regimes. 
Typical  examples  of  microscale  atmospheric  phenomena  are  tornadoes, 
deep  convection  systems,  short  gravity  waves,  dust  devils,  plumes, 
turbulence,  etc. 
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SUBDIVISION  OF  MESOSCALE  REGIME 

■  «  * 

Each  of  the  above  scale  regimes  covers  a  broad  range  of  sub¬ 
scales.  Since  macro,  meso,  and  micro  are  the  Greek  equivalents  for 
large,  intermediate,  and  small,  respectively,  the  Greek  symbols  a, 

B,  and' y  have  also  been  used  to  designate  subdivisions  in  each  scale 
regime.  For  the  mesoscale  regime,  these  subdivisions  are  as  follows 
(Refs.  2,  10,  11,  12): 

(a)  Meso-a  scale,  where  the  mesoscale  dimensions  are  within 
the  range  of  2000  to  200  km.  This  mesoscale  subrange 
corresponds  to  those  of  phenomena  such  as  hurricanes  and 
fronts,  which  have  time  scales  of  the  order  of  days. 

Hence,  mesoscale  weather  forecasting  in  the  meso-a  sub¬ 
regime  involves,  for  example,  predictions  for  periods 
longer  than  24  hours  of  the  future  path  of  hurricanes  or 
fronts . 

(b)  Meso-B  scale,  where  the  mesoscale  dimensions  are  within 
the  range  of  200  to  20  km.  This  subrange  of  scales  cor¬ 
responds  to  those  of  phenomena  such  as  disturbances  in¬ 
duced  by  mountains  and  lakes,  squall  lines,  cloud  clusters 
nocturnal  low-level  jets,  inertial  waves,  etc.  These 
types  of  phenomena  have  time  scales  of  the  order  of  a  few 
hours  to  a  day. 

(c)  Meso-y  scale,  where  the  mesoscale  dimensions  are  within 
the  range  of  20  to  2  km.  This  subrange  of  scales  is 
given  by  those  of  individual  thunderstorms,  clear  air  tur¬ 
bulence,  urban  effects,  etc.  These  types  of  phenomena 
have  time  scales  of  the  order  of  one  hour. 

The  above  subdivision  of  the  mesoscale  regime  is  based  on  a 
probabilistic  use  of  the  horizontal  scales  of  motion  for  mesoscale 
processes ,  i_Le_.  .  on  the-. definition  o f  scetl-s - -i nervm'feTrt  "S’ ~ ~WnTc n~TTa ve 
maximum  probabilities  of  containing  a  given  type  of  mesoscale  phe¬ 
nomena.  The  time  scale  could  also  have  been  used  to  subdivide  the 

* 

mesoscale  regime.  However,  it  has  been  found  that  the  time  scale 


can  give  afnbiguous  results  in  the  mesoscale  regime  as  the  result 
of  uncertainties  in  the'  observed  frequency  of  mesoscale  events 
(Ref.  .2). 

MESOSCALE  WEATHER  FORECASTING  FOR  TACTICAL  OPERATIONS 

The  above  subdivision  of  the  mesoscale  regime  indicates 
that  typical  battlefield  scales  (Exhibit  24)  correspond  to  the 
meso-B  (20  id  i  200  km)  and  meso-y  (2  i  d  f  200  km)  subregimes. 
Hence,  the  time  duration  of  mesoscale  weather  forecasting  for 
tactical  operations  are  limited  to  about  24  hours.  For  this 
reason,  verification  data  for  mesoscale  weather  forecasts  in 
Western  Europe  by  the  Air  Weather  Service  are  also  limited  to 
a  24-hour  forecast  time  (Appendices  E  and  G). 

VERTICAL  EXTENT  OF  MESO-B  AND  MESO-y  PHENOMENA 

As  indicated  previously,  typical  types  of  meso-B  atmos¬ 
pheric  phenomena  include  meteorological  disturbances  induced  by 
mountains  and  lakes,  squall  lines,  cloud  clusters,  nocturnal 
low-level  Jets,  inertial  waves,  etc.  Such  phenomena  can,  in 
turn,  induce  weather  phenomena  of  tactical  interest,  i.e.,  low 
visibilities,  low  ceilings,  large  precipitation  rates,  and  meso¬ 
scale  winds.  The  vertical  extent  of  meso-B  weather  phenomena 
is,  for  example,  controlled  by  (a)  the  orographic  effects  from 
mountain  and  lake  disturbances  that  are  important  in  the  bound¬ 
ary  layer,  i.e.,  from  the  ground  to  about  1-km  altitude.  This 
altitude  range  corresponds  to  pressure  levels  that  vary  from 
about  1013  mbar  at  the  ground  to  about  900  mbar  at  1  km,  and 
(b)  squall  lines,  which  can  take  place  at  altitudes  between  0.3 
to  10  km  or  from  about  990  to  265  mbar.  The  significance  of  the 

vertica  l  extent^  _o  f_M§!£9~fL  J?  henpme  na_  is_tj\a,t  ^me.eoena  l  e-  - 

forecasting  for  tactical  operations  must  take  into  account  the  . 
meteorology  of  both  the  boundary  layer  and  the  free  troposphere 
above  the  boundary  layer  (Ref.  10).  These  considerations  are 


also  applicable  to  the  meso-y  subregime  because  urban  effects, 
for  example,  are  important  near  the  ground,  whereas  individual 
storms  take  place,  in  the  same  altitude  range  as  that  for  squall 
lines  (Ref.  11). 
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WEATHER  FORECASTING  TECHNIQUES 


INI RODUCTION 

The  main  objective  of  this  appendix  is  to  provide  background 
information  concerning  the  three  available  techniques  for  meso- 
scale  weather  forecasting:  persistence,  subjective  (or  local  or 
station),  and  objective  (or  guidance). 

PERSISTtNCE  mesoscale  weather  forecasting 

The  fundamental  assumption  in  persistence  weather  forecast¬ 
ing  is  simply  that  the  local  weather  prevailing  at  present  or 
during  the  immediate  past  will  continue  to  do  so  in  the  immediate 
future  to  the  forecast  time.  These  conditions  lead  to  either 
static  or  diurnal  persistence  forecasts,  respectively. 

As  it  will  become  evident  from  forecast  verification  data 
in  the  subsequent  appendix,  the  accuracy  or  "reliability"  of 
weather  forecasts  depends  on  the  frequency  of  a  given  meteoro¬ 
logical  event.  It  will  then  be  seen  that  the  reliability  of 
persistence  forecasts  is  difficult  to  improve  on  by  the  other 
two  types  of  forecasts  (subjective  and  objective)  regardless  of 
the  frequency  of  the  event. 

If  V(s,t)  denotes  the  visibility  as  a  function  of  location 
or  station  (s)  and  future  time  (t),  the  static  persistence  fore¬ 
cast  of  visibility  at  the  same  station  and  future  time  (6t) 
from  the  present  (tQ)  may  be  written  as  follows: 


where 


3V(s,t)  _  n 
3t  ' 


(D-2) 


i.e,,  the  observed  visibility  will  remain  without  change  to  the 
forecast  tine. 

For  diurnal  persistence,  the  corresponding  formulations 
become : 


V (s  ,tQ  +  fit) 


V(s,tQ)  + 


3V(s.f) 


(D-3) 


and 


(D-- 4 ) 


where  t*  denotes  the  time  of  the  immediate-past  observations 
during  a  time  interval  fit*.  A  fundamental  assumption  of  diurnal 
persistence  weather  forecasting  of  visibility,  for  example,  is 
then  given  by  Eq.  D-4 ;  i.e.,  the  immediate-past  observations  of 
visibility  will  repeat  themselves  in  the  immediate  future  time 
of  the  forecast. 

Equations  D-l  to  D-*J  indicate  that  static  or  diurnal  per¬ 
sistence  forecasts  are  based  solely  on  local  observations,  for 
example,  of  the  visibility  at  the  particular  station  or  local¬ 
ity  of  interest.  Since  persistence  forecasts  have  no  model 
skill  to  predict  changes  in  weather  ever ’ s,  persistence  cannot 
forecast  the  onset  of  infrequent  events.  Because  of  this  char¬ 
acteristic  and  the  simplicity  of  static  persistence,  its  accu¬ 
racy  provides  an  important  reference  for  assessing  the  relative 
forecasting  skills  of  the  subjective  and  objective  techniques 
which  attempt  to  improve  on  persistence,  i.e.,  on  Eqs.  D-2  and 
D-4 . 


SUBJECTIVE  MESOSCALE  WEATHER  FORECASTING 

» 

The  subjective  (i.e.,  local  or  station)  weather  forecast  is 
the  product  released  at  each  meteorological  facility  (usually 
airfields)  by  the  resident  meteorologist.  This  type  of  forecast 
is  known  as  a  subjective  forecast,  because  it  is  the  result  of 
man's  judgment  of  all  the  data  that  are  available  to  him  for  his 
particular  station.  The  scope  of  the  data*  for  "Western 'European  ' 
stations  includes  local  observations  [i.e.,  V(s,t  ,t’)],  clima¬ 
tology  for  his  specific  station,  and  synoptic  (i.e.,  large 
scale)  weather  charts  prepared  by  central  meteorological  facil¬ 
ities  (e.g..  Air  Force  Global.  Weather  Center).  In  the  contig¬ 
uous  United  States,  resident  meteorologists  may  also  have  access 
to  objective  or  guidance  forecasts,  as  defined  subsequently. 

Man-  versus  machine-forecasting  is  a  major  issue  In  the  civilian 
weather  forecasting  community  today.  The  issue  stems  from  the 
automation  of  weather  forecasting  at  central  facilities  and  the 
decreasing  effect  of  the  subjective  element  on  the  final  product 
(Refs.  13,  14,  15). 

OBJECTIVE  MESOSCALE  WEATHER  FORECASTING 

A  basic  aim  in  objective  or  guidance  mesoscale  weather 
forecasting  is  to  improve  on  persistence  by  replacing  Eqs.  D-2 
and  D-4  with  a  deterministic-statistical  or  objective  procedure 
for  the  evaluation  of  the  local  future  time  gradient  3V(s,t)/9t. 
The  basic  steps  in  objective  or  guidance  weather  forecastings 
are  as  follows: 

(1)  Use  of  a  radiosonde  network  to  obtain  upper  air  data 
in  addition  to  surface  data.  The  resolution  of  the 
radiosonde  data  is  of  the  order  of  300  km  (Ref.  16). 
The  scope  of  the  data  Involves  mainly  North  America 
and  Europe.  The  data  are  obtained  twice  a  day  at  00Z 
and  12Z  (where  Z  stands  for  the  standard  GMT).  A 
basic  limitation  in  the  scope  of  the  upper  air  data 
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is  lack  of  adequate  coverage  over  the  extensive  areas 
of  the  oceans. 

(2)  Analysis  and  interpolations  of  upper  air  observations 
to  determine  the  dependent  variables  (e.g.,  winds, 
temperature,  humidity,  height  of  given  pressure  levels, 
etc.)  at  specific  points  corresponding  to  those  de- 

. .  •  . .  M  .  .......  .  . . . . *  . 

fining  the  numerical  grid  for  numerical  calculations 
(Ref.  17),  which  are  described  below. 

(3)  Use  of  the  conservation  equations  for  atmospheric 
motions  in  the  free  troposphere  utilizing  electronic 
computers  (e.g..  Refs.  17,  18,  19).  This  procedure 
is  known  as  numerical  weather  prediction  (NWP).  The 
NWP  utilizes  the  initial  data  obtained  at  00Z,  for 
example,  and  attempts  to  calculate  the  future  evolu¬ 
tion  of  the  prevailing  upper  air  meteorology  at  the 
points  defining  the  numerical  grid  with  a  typical  size 
of  about  200  km  (Ref.  20).  The  product  of  NWP  is  the 
synoptic  weather  charts  at  several  pressure  levels 
(e.g.,  500  mb,  etc.)  of  the  free  troposphere. 

(4)  Use  of  a  statistical  procedure  that  attempts  to  cor¬ 

relate  predictor  variables  from  numerical  weather 
(i.e.,  obtained  from  NWP)  and  predictant  variables 
for  real  weather  (e.g.,  visibility).  This  procedure 
is  known  as  model  output  statistics  (MOS).  The  basic 
steps  in  MOS  are  as  follows  (Refs.  7.  21):  (a)  gather¬ 

ing  of  statistics  for  candidate  NWP  predictors  and 
observed  predictants,  (b)  "screening"  analysis  to 
eliminate  predictors  with  low  correlations,  and  (c) 
establishing  MOS  relationships  among  predictors  and 
predictants . 

The  basic  aim  of  the  combined  deterministic  (NWP)  and  sta¬ 
tistical  (MOS)  weather  forecast  procedure  is  to  produce  forecasts 
for  boundary  layer  variables  (Appendix  C)  such  as  visibility, 
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i.e.,  variables  for  which  there  are  no  available  models  of  the 
phenomena  itself.  The  use  of  MOS  is  an  attempt  to  produce  fore¬ 
cast  data  within  the  meso-3  (20  £  d  £  20C  km)  and  meso-y  (2  s  d 
*  20  km)  from  synoptic  NWP  data  valid  for  the  meso-a  (200  <  d  s* 
2000  km)  and  macroscale  regimes  (Appendix  C). 

There  are  two  important  factors  concerning  the  objective 
(guidance)  weather  forecast  technique  based  on  the  NWP -MOS  pro¬ 
cedure.  The  first  one  has  to  do  with  the' time  required  to  com¬ 
plete  this  complex  procedure,  which  starts  with  the  gathering  of 
radiosonde  data,  and  it  is  completed  with  transmission  of  syn¬ 
optic  charts  and  guidance  forecasts  to  local  weather  stations. 

On  the  average,  this  preparation  and  distribution  time  of  guid¬ 
ance  forecasts  can  be  of  the  order  of  several  hours.  As  indi¬ 
cated  in  Appendix  G  (Fig.  G-l),  the  synoptic  charts  appear  at 
about  three  hours  subsequent  to  observations,  whereas  the  guid¬ 
ance  forecasts  based  on  MOS  do  so  at  about  five  hours  after  the 
upper  air  observations.  The  second  factor  has  to  do  with  the 
assigned  probability  for  the  forecast  event.  The  NWP  product 
can  be  interpreted  in  terms  of  probabilities  for  the  forecast 
event.  However,  the  probability  forecast  may  be  converted  into 
a  categoric  (yes/no)  forecast  with  an  implied  100  percent  fore¬ 
cast  probability  for  the  forecast  event.  This  latter  procedure 
involves  comparisons  between  the  calculated  and  threshold  prob-  • 
ability  values  for  a  particular  class  of  event. 

As  it  will  become  evident  in  Appendix  E,  forecast  verifi¬ 
cation  data  for  phenomena  such  as  low  visibility  show  that 
guidance  forecasts  cannot  improve  significantly  on  the  low  re¬ 
liabilities  of  persistence  forecasts.  Several  factors  for  this 
relatively  poor  performance  of  current  guidance  forecast  products 
are  as  follows:  (1)  lack  of  direct  observations  at  the  local 
station;  i.e.,  of  V(s,t*)  in  Eq.  D-l,  (2)  lack  of  a  physical 
model,  based  on  boundary  layer  phenomena ,  for  weather  variables 
such  as  visibility,  and  (3)  low  resolution  of  synoptic  NWP. 

This  latter  factor  does  not  allow  to  take  into  account  effects 
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of  meso-3  phenomena  (such  as  the  disturbances  from  mountains 
and  lakes,  squall  lines,  etc.)  on  the  free  troposphere. 


*  < 

►* 


APPENDIX  E 

FORECAST  VERIFICATION  METHODOLOGY 


Introduction  E-3 

Format  of  Weather  Forecast  Verification  Data  E-3 

Weather  Forecast  Verification  Parameters  E-5 

Categoric,  Probabilistic,  and  Biased  E-8 

Forecasti ng 

Forecast  Verification  Data  for  Visibility  E-ll 

and  Ceiling 

Prefigurance  as  a  Function  of  Forecast  Time  E - 1 3 

and  Frequency 

Summary  of  Visibility  and  Ceiling  Results  E - 1 5 


Summary  of  Visibility  and  Ceiling  Results  E - 1  5 


I 


APPENDIX  E 


FORECAST  VERIFICATION  METHODOLOGY 


INTRODUCTION 

Appendix  D  has  described  the  three  forecast  techniques  that 
are  available  for  mesoscale  weather  forecasting  of  weather  vari¬ 
ables  of  tactical  interest.  These  three  forecast  techniques  are 
persistence,  subjective  (local  or  station),  and  objective  (guid¬ 
ance).  The  main  aim  of  this  appendix  is  to  identify  the  weather 
forecast  verification  parameters  and  to  establish  the  relative 
quality  of  the  foregoing  three  types  of  forecast  for  visibility, 
ceiling,  precipitation,  and  surface  winds. 

FORMAT  OF  WEATHER  FORECAST  VERIFICATION  DATA 

The  accuracy  of  present  mesoscale  weather  forecasting  skills 
may  be  determined  from  a  verification  procedure,  wherein  opera¬ 
tional  forecasts  are  compared  with  the  observed  weather  at  the 
forecast  time.  This  verification  procedure  is  carried  out  at 
selected  verification  stations  over  a  period  of  several  months 
or  seasons.  The  number  of  verification  stations  is  large  enough 
to  cover  a  large  geographical  domain  such  as  Western  Europe  or 
the  contiguous  United  States.  This  procedure  yields  statistics 
for  assessing  the  accuracy  of  persistence,  subjective  (local  or 
station),  and  objective  (guidance)  forecasting  of  a  given  type 
of  event  (e.g.,  visibility)  for  different  forecast  times  (hours) 
and  several  categories  (e.g.,  ranges  of  visibility)  of  the  event. 

Since  the  development  of  guidance  forecasts  is  of  rather 
recent  origin  (Ref.  22),  it  is  to  be  expected  that  the  verifica- 


tion  methodology  of  weather  forecasting  is  also  in  a  correspond¬ 
ing  state  of  development.  For  example,  it  is  only  very  recent 
efforts  at  the  Air  Weather  Service  of  the  U.S.  Air  Force  and  the 
National  Weather  Service  (Appendix  G)  that  have  produced  sta¬ 
tistics  for  individual  instead  of  combined  events  cf  visibility 
and  ceiling. 

The  statistical  verification  data  for  persistence,  subjec¬ 
tive,  and  objective  forecasts  for  a  given  type  of  event  (e.g., 
visibility)  are  usually  given  in  the  matrix  form  of  a  contingency 
table.  Table  E-l  shows  a  sample  of  the  verification  statistics 
for  14,142  persistence  forecasts  of  visibility  of  3-hour  duration 
at  92  stations  within  the  contiguous  United  States  during  October 
1975  to  March  1976  (Appendix  G,  Table  G-40). 

TABLE  E-l.  Sample  Contingency  Table  for  Visibility  (NWS) 
(Persistence,  3  hr,  October  1975-March  1976,  USA) 


Forecast  s 


1 

2 

3 

4 

5 

T 

CO 

c* 

l 

l6l 

38 

40 

30 

76 

345 

O 

•H 

2 

30 

37 

46 

20 

57 

190 

-P 

*»> 

3 

32 

48 

229 

139 

285 

733 

U 

<D 

4 

12 

19 

89 

211 

412 

743 

CO 

& 

O 

5 

16 

28 

134 

219 

11,734 

12,131 

T 

251 

170 

538 

619 

12,564 

14,142 

The  columns  1 

to  5  in 

this  table 

indicate  the  number  of 

forecasts  made  in  each  of  the  five  categories  of  visibility,  as 
defined  in  Table  E-2,  whereas  the  corresponding  rows  show  the 
actual  occurrences  or  observations.  The  bottom  row  indicates 


the  breakdown  of  the  14,142  forecasts  into  the  five  categories, 
whereas  the  column  to  the  extreme  right  indicates  the  total 
number  of  observations  in  each  category.  The  diagonal  of  this 
matrix  shows  the  number  of  correct  forecasts  in  each  category. 
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Hence,  column  1  shows,  for  example,  that  251  forecasts  were  made 
In  category  1;  only  l6l  of  these  forecasts  were  correct,  and  the 
balance  actually  fell  In  the  other  categories  as  shown  in  column 
1.  Likewise,  the  top  row  indicates  that  there  were  3^5  observa¬ 
tions  in  category  1;  only  l6l  of  these  observations  were  fore¬ 
cast  correctly. 

The  right-most  column  of  Table  E-l  shows  the  frequencies  of 
the  observed  categories  of  visibility.  This  column  indicates 
that  there  were  12,131  observations  of  visibility  higher  than  5 
miles,  i.e.,  86  percent  of  the  observed  visibilities  during  the 
period  (October  1975-March  1976)  correspond  to  clear  or  good 
visibility.  Likewise,  the  diagonal  of  this  matrix  indicates  that 
there  were  11, 73^  correct  forecasts  out  of  the  12,131  observed 
visibilities  that  were  higher  than  5  miles;  i.e.,  97  percent  of 
the  visibilities  for  clear  or  good  visibility  were  found  to  be 
correct.  This  sample  table  for  a  short  forecast  time  of  three 
hours  already  suggests  that  the  acid  test  of  weather  forecasting 
capabilities  lies  on  the  verification  of  the  low  frequency  cate¬ 
gories  of  events  over  local  areas. 

TABLE  E-2.  Classification  of  Visibility  Categories  at  NWS 


Category 


Visibility  Range, 
_ miles _ 

V  <  0.5 
0.5  *  V  <  1 

1  *  V  <  3 
3  i  V  <  5 

V  >  5 


WEATHER  FORECAST  VERIFICATION  PARAMETERS 

The  foregoing  discussion  of  the  sample  contingency  table 
suggests  the  definition  of  parameters  for  establishing  the  sta¬ 
tistics  of  weather  forecasting.  It  should  be  notv.d  that  for 
the  hypothetical  case  of  perfect  forecasting,  for  example. 
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every  number  other  than  those  along  the  diagonal  of  the  5x5 
matrix  would  be  zero.  In  such  a  case,  the  numbers  along  the 
diagonal  and  bottom  row  for  each  category  would  be  Identical  to 
the  corresponding  numbers  of  the  column  in  the  extreme  right . 

For  actual  imperfect  forecasting,  the  contingency  Table  E-l  sug¬ 
gests  the  definition  of  the  forecast  verification  parameters. 

If  in  the  contingency  Table  E-l,  denotes  the  hits  for 
any  category  (i.e.,  the  numbers  along  the  diagonal),  0^  the 
total  number  of  occurrences  or  observations  for  any  category 
(i.e.,  the  numbers  in  the  column  to  the  extreme  right),  and 
the  total  number  of  forecasts  for  a  given  category  (bottom  row), 
then  the  verification  parameters  are  as  follows: 

1.  Prefigurance  (PF^,  which  is  given  by  the  ratio  H^/C^ , 
i.e.,  the  ratio  of  the  number  of  correct  forecasts  in 
a  given  category  to  the  total  number  of  observations 
in  the  same  category  within  the  verified  set  of  fore¬ 
casts.  For  example,  the  prefigurance  for  category  1 

•  in  Table  E-l  is  161/345,  or  0.47. 

2.  Post-Agreement  (P^),  which  is  given  by  the  ratio  J^/F^ 
i.e.,  the  ratio  of  the  number  of  correct  forecasts  in  a 
given  category  to  the  total  number  of  forecasts  in  the 
same  category  within  the  verified  set  of  forecasts. 

The  post-agreement  in  Table  F-l  for  category  1  is  161/ 
251,  or  0.64. 

3.  Bias  ( ) ,  which  is  given  by  the  ratio  F.^/0.^,  i.e.,  the 
ratio  of  the  total  number  of  forecasts  in  a  given  cate¬ 
gory  to  the  total  number  of  observations  in  the  same 
category  within  the  verified  set  of  forecasts.  The 
bias  in  Table  E-l  for  category  1  is  251/345,  or  0.73* 

4.  Threat  Score  (TS^),  which  is  given  by  the  ratio  H^/(F^ 

+  0^  -  Hi),  i.e.,  the  ratio  of  the  number  of  correct 
forecasts  in  a  given  category  to  a  number  given  by  the 
sum  of  the  total  number  of  forecasts  and  observations 
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less  the  number  of  correct  forecasts,  all  in  the  same 
category.  The  threat  score  in  Table  E-l  for  category 
1  is  161/(251  +  3^5  -  161),  or  0.37. 

5.  Relative  Frequency  (RF^),  which  is  given  by  0^/Z0^, 
i.e.,  the  ratio  of  the  number  of  observations  in  a 
given  category  to  the  total  number  of  observations. 

The  relative  frequency  for  a  given  category  is  thus 
the  ratio  of  the  number  in  the  column  to  the  extreme 
right  for  that  category  to  the  total  number  of  obser¬ 
vations.  The  relative  frequency  in  Table  E-l  for  cate¬ 
gory  1  is  3^5/14, 1^2,  or  0 .024.  (The  absolute  fre¬ 
quency  for  category  1  would  be  3**5  events  per  half  year 
of  the  verification  period.) 

From  the  foregoing  definitions  for  the  pref igurance ,  post¬ 
agreement,  and  bias,  these  verification  parameters  are  related 
as  follows: 


i 


.e 


y 


or 


Hi/0i 


PFi  =  •  B^ 


(E-l) 


(E-2 ) 


Similarly,  the  threat  score  may  be  expressed  in  terms  of  the 
other  verification  parameters.  For  example,  dividing  the 
numerator  and  denominator  in  its  definition  by  it  is  ob¬ 
tained 


TSj^  = 


H. 


PF , 


Pi  + 


°i  '  Hi 


1  + 


B1  -“TFY  * 
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or  solving  for  the  pref igurance : 


ppi  '  <l  +  Bi>  nTsY  •  <E-3> 

Likewise,  by  dividing  the  numerator  and  denominator  of  TS^  by 
Fi}  the  post-agreement  is  given  by 

1  +  B  TS 

PAi  =  *  1  +  TS1  ‘ 

For  the  hypothetical  case  of  perfect  forecasting,  the  pre- 
f igurance,  post-agreement,  and  bias  would  be  equal  to  unity  for 
every  category  as  indicated  by  their  definitions  for  the  case 
when  =  F^  =  0^ .  Foj^'actual  imperfect  forecasting,  Eq.  E-l 
shows  that  the  post-agreement  is  inversely  proportional  to  the 
bias  and  it  can  be  increased  by  using  a  bias  B^  <  1 .  Similarly, 
Eq.  E-2  indicates  that  the  pref igurance  can  be  increased  by  us¬ 
ing  a  bias  B^  >  1 .  Therefore,  for  actual  imperfect  forecasting 
it  becomes  important  to  understand  both  the  difference  between 
categoric  (i.e.,  yes/no)  and  probabilistic  (maybe)  forecasts  as 
well  as  biased  forecasting, 

CATEGORIC,  PROBABILISTIC,  AND  BIASED  FORECASTING 

As  indicated  in  Appendix  D,  the  difference  between  cate¬ 
goric  and  probabilistic  forecasts  is  that  the  former  has  an  im¬ 
plied  probability  of  100  percent  for  the  forecast  of  a  given 
category  of,  say,  visibility  (e.g..  Table  E-2).  This  is  the 
nature,  for  example,  of  persistence  forecasts.  For  objective 
or  guidance  forecasts.  Appendix  D  indicated  that  the  output  of 
numerical  weather  prediction  (NWP)  and  model  output  statistics 
(MOS)  is  in  the  form  of  probabilities  for  the  occurrence  of 
each  of  the  several  categories  of,  say,  visibility.  For  a 
categoric  forecast  of  a  given  event,  it  becomes  then  necessary 
to  reduce  the  probabilities  of  the  several  categories  into  the 
single  category  of  the  forecast  event  with  an  implied  proba- 


bility  of  100  percent.  This  reduction  procedure  Involves  two 
basic  steps:  (1)  definition  of  threshold  probabilities  for  the 
occurrence  of  each  category  of,  say,  visibility,  and  (2)  system¬ 
atic  comparisons,  starting  with  the  lowest  category ..  (e...g cate¬ 
gory  1,  Table  E-2),  between  calculated  and  threshold  probabil¬ 
ities  so  as  to  identify  a  category  where  the  calculated  proba¬ 
bility  first  exceeds  that  of  the  corresponding  threshold  value. 
An  important  point  here  is,  then,  that  the  available  contingency 
tables  for  verification  of  visibility  and  ceiling  forecasts  are 
applicable  to  categoric  forecasting.  Although  the  methodology 
for  the  verification  of  probabilistic  forecasts  is  in  hand, 
there  is  not  yet  any  verification  data  for  probabilistic  fore¬ 
casts.  The  verification  data  for  probabilistic  forecasts  would 
take  the  form  of  a  contingency  ’’volume"  as  generated  by  the 
probability  parameter  placed  normal  to  the  present  contingency 
tables  for  the  implied  100  percent  probability  of  categoric 
forecasts . 

The  concept  of  biased  forecasting  may  perhaps  be  illus¬ 
trated  best  by  considering  an  analogy  wherein  the  14,142  fore¬ 
casts  in  Table  E-l  are  thought  to  be  replaced  by  the  same  number 
of  marbles  within  a  box.  The  marbles,  of  five  different  colors, 
are  assumed  to:  (1)  be  well  mixed,  (2)  be  of  the  same  size,  (3) 
be  of  equal  brightness,  (4)  fall  into  a  color  frequency  distri¬ 
bution  similar  to  the  total  column  (T)  in  Table  E-l,  and  (5)  be 
exposed  to  a  medium  level  of  illumination.  If,  for  example,  a 
green  color  is  assigned  to  the  most  frequent  category  5,  most  of 
the  marbles  (86  percent)  would  then  be  green.  The  role  of  the 
weather  forecaster  equipped  with  different  probabilities  for 
each  category  in  Table  E-l  may  then  be  thought  to  be  equivalent 
to  that  of  an  observer  who  is  provided  with  a  set  of  glasses  of 
different  degrees  of  darkness.  For  weather  forecasting  of  in¬ 
frequent  categories  with  very  high  probabilities,  the  observer 
in  the  analogy  would  be  provided  with  clear  glasses.  In  such  a 
case,  he  would  have  no  difficulty  in  picking  only  the  few,  say, 
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blue  marbles  If  such  color  represents,  for  example,  category  1; 
and  he  could  do  so  in  a  number  of  draws  equal  to  the  number  of 
occurrences  In  Table  E-l .  This  would  be  equivalent  to  perfect 
forecasting  in  which  all  the  verification  parameters  become 
unity.  However,  as  the  forecast  probabilities  become  closer  in 
magnitude  to  those  of  the  threshold  probabilities,  the  observer’s 
glasses  would  also  become  darker.  He  would  then  have  increasing 
difficulty  in  picking  only  the  blue  marbles  for  category  1. 
Nevertheless,  if  the  criterion  of  post -agreement  were  used  to 
test  his  skill,  he  could  achieve  superior  performance  with  im¬ 
perfect  forecasting  technology  by  calling  the  frequent  green 
color  whenever  he  wears  dark  glasses;  i.e.,  by  accepting  a  small 
degradation  of  his  near  perfect  skill  for  the  frequent  green 
marbles  to  compensate  for  significant  improvements  in  the  infre¬ 
quent  blue  marbles.  This  situation  would  be  equivalent  to  under¬ 
biased  forecasting  where  B  <<  1 .  However,  if  the  criterion  of 
prefigurance  were  used  instead  to  test  his  skill,  he  could  at¬ 
tempt  to  improve  his  performance  by  calling  the  infrequent  blue 
color  whenever  he  wears  dark  glasses,  so  as  to  collect  all  the 
blue  marbles,  This  situation  would  be  equivalent  to  overbias 
forecasting  where  B  >>  1. 

For  conditions  where  the  bias  is  reasonably  close  to  unity, 
the  use  of  the  prefigurance  or  post-agreement  verification  param¬ 
eter  would  tend  to  give  the  same  result  in  regard  to  the  validity 
or  reliability  of  average  weather  forecasts.  However,  even  in 
these  cases,  the  prefigurance  criterion  is  preferable  because 
(1)  its  lower  sensitivity  to  bias  as  compared  with  post-agree¬ 
ment,  i.e.,  prefigurance  can  never  give  perfect  scores  for  in¬ 
frequent  categories  with  imperfect  forecast  technology  and 
reasonable  bias,  and  (2)  it  always  commits  the  forecaster  to 
action.  Hence,  the  choice  of  prefigurance  over  post-agreement 
implies  that  it  is  more  important  in  measuring  forecasting  skill 
to  use  the  percent  of  correct  forecasts  for  a  given  category  of 
occurrences  than  the  percent  of  correct  forecasts  from  an 
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arbitrary  set  of  forecasts.  Note  that  the  results  in  Table  E-l 
for  a  3-hour  forecast  of  visibilities  V  <  0.5  miles  give  pre- 
figurance  and  post -agreement  values  of  0.47  and  0.64,  respec¬ 
tively,  for  a  bias  of  0.73. 

The  accuracy  of  current  forecasting  skill  can,  therefore, 
be  established  from  the  decay  of  the  prefigurance  as  a  function 
of  forecast  time  (hours)  as  derived  from  contingency  tables  for 
different  forecast  times  and  for  each  type  of  forecast,  i.e., 
persistence,  subjective,  and  objective  (Appendix  D). 

FORECAST  VERIFICATION  DATA  FOR  VISIBILITY  AND  CEILING 

Verification  data  for  the  determination  of  the  current 
accuracy  of  mesoscale  forecasts  of  visibility  and  ceiling  were 
available  at  the  Air  Weather  Service  (AWS)  of  the  U.S.  Air  Force 
and  the  Technique  Development  Laboratory  (TDL)  of  the  National 
Weather  Service,  NOAA  (Appendix  G).  The  verification  data  were 
in  the  form  of  contingency  tables  £e.g.,  Table  E-l  for  categoric 
(yes/no)  or  nonprobabilistic  forecasts].  The  AWS  data  were 
limited  to  persistence  and  station  (subjective)  forecasts, 
whereas  the  TDL  data  included  guidance  (objective)  forecasts. 

The  forecast  verification  data  are  of  a  statistical  nature, 
where  sets  of  forecasts  are  verified  against  actual  occurrences 
over  a  large  geographical  domain  during  a  long  time.  The  scope 
of  the  AWS  data  included  35  stations  in  Western  Europe  within 
a  time  span  between  September  1976  and  March  1977 »  whereas  that 
of  the  TDL  data  included  92  stations  within  the  contiguous 
United  States  during  October  1975  to  March  1976. 

The  contingency  tables  for  the  AWS  data  were  given  by  month 
for  either  persistence  or  station  and  forecast  times  of  3,  6, 

12,  and  24  hours.  The  TDL  data  included  contingency  tables  for 
guidance  and  the  forecast  tines  were  3,  6,  and  12  hours  for 
local  or  station  and  7,  13 >  and  19  hours  for  guidance.  The 
basic  AWS  and  TDL  contingency  tables  for  visibility  and  ceiling 


are  given  in  Appendix  G.  However,  a  summary  of  such  results  is 
as  given  below. 

Tables  E-3  and  E-4  provide  a  summary  of  AWS  prefigurance 
data  for  visibility  for  station  and  static  persistence  (Appendix 
D)  forecasts,  respectively.  Each  table  shows  prefigurance  data, 
in  percent,  for  each  month  (September  to  March)  and  the  whole 
period.  The  data  are  given  by  category  which  represent  several 
ranges  of  visibility:  i.e.,  categories  A,  B,  C,  and  D  denote 
visibility  (V)  in  the  range  V  <  0.5  nm,  0.5  £  V  <  2  nm,  2  £  V  < 

3  nm,  and  V  s  3  nm,  respectively.  For  each  category,  each  table 
shows  the  decay  in  prefigurance  as  a  function  of  forecast  time 
between  3  and  24  hours.  A  comparison  of  Tables  E-3  and  E-4 
shows  that  for  visibility,  there  is  very  little  improvement  in 
the  prefigurance  obtained  by  local  forecasters  over  that  of  per¬ 
sistence.  Hence,  the  basic  assumption  made  in  static  persistence 
for  mesoscale  forecasts  (Eq.  D-2,  Appendix  D)  is  very  difficult 
to  improve  on  by  weather  forecasters  of  visibility. 

Tables  E-5  and  E-6  provide  a  similar  summary  of  AWS  pre¬ 
figurance  data  for  ceiling  for  station  and  static  persistence 
forecasts,  respectively.  The  categories  A,  B,  C,  and  D  denote 
ceiling  (C)  in  the  range  C  <  200  ft,  200  £.  C  <  1000  ft, 

1000  s  C  <  3000  ft,  C  >  3000  ft,  respectively.  The  data  in 
these  tables  show  again  that  for  mesoscale  forecasts  of  ceiling, 
there  is  no  significant  improvement  in  the  prefigurance  obtained 
by  man  over  that  of  persistence  forecasts. 

Table  E-7  illustrates  the  AWS  relative  frequency  data  for 
each  category  of  visibility  and  ceiling  for  local  forecasts. 

This  table  shows  (1)  a  rather  low  frequency  for  the  first  three 
categories  of  either  visibility  (V  <  3  nm)  or  ceiling  (C  <  3000 
ft),  and  (2)  very  high  frequancies  for  events  of  good  or  clear 
weather , 

Tables  E-8  and  E-9  provide  a  summary  of  TDL  prefigurance 
data  for  visibility  and  ceiling,  respectively,  for  persistence. 
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local,  and  guidance  forecasts.  The  results  in  these  tables  in¬ 
dicate  that  the  prefigurance  values  for  persistence  forecasts 
are  difficult  to  improve  on  by  local  or  guidance  forecasts. 

In  order  to  determine  the  effect  of  category  criteria  on 
the  prefigurance,  the  Individual  categories  were  added  to  yield 
new  categories  defined  by  A,  A+B,  A+B+C,  and  D  for  the  AWS 
data,  and  1,  1  +  2,  1  +  2  +  3,  1  +  2  +  3  +  **,  and  5  for  the  TDL 
data.  The  corresponding  individual  contingency  tables  were 
added  as  described  in  Appendix  G.  The  results  are  shown  in 
Tables  E-10  and  E-ll  for  the  AWS  and  TDL  data,  respectively. 
These  tables  indicate  again  that  persistence  is  very  difficult 
to  improve  on  by  either  local  or  guidance  forecasts. 

PREFIGURANCE  AS  A  FUNCTION  OF  FORECAST  TIME  AND  FREQUENCY 

As  indicated  in  Tables  E-10  and  E-ll,  the  forecast  verifi¬ 
cation  data  show  that  the  prefigurance  for  visibility  or  ceiling 
decays  with  forecast  time,  a  decay  that  depends  on  the  category 
or  frequency  of  the  events.  Since  the  data  include  forecast 
times  between  3  and  24  hour  duration,  it  is  of  some  interest  to 
describe  the  typical  decay  in  prefigurance  at  shorter  times, 
which  can  be  done  through  the  use  of  available  forecast  verifi¬ 
cation  data  for  other  types  of  events.  Thus,  forecast  verifica¬ 
tion  data  for  temperature  and  precipitation,  for  example,  show 
that  the  decay  in  prefigurance  from  the  time  of  forecast  re¬ 
lease  can  be  exponential  (Ref,  23);  i.e,,  the  prefigurance  PF.^ 
for  a  given  class  of  event  (e.g.,  visibility  or  ceiling)  may  be 
expressed  as 


where  Is  an  empirical  coefficient  that  depends  on  the  cate¬ 
gory  (or  frequency)  of  the  event  and  t  denotes  the  time  from 
forecast  release.  The  forecast  verification  data  for  tempera¬ 
ture  (T)  and  precipitation  (p)  indicate  that  6T  -  0.02  and 
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and  B  =0.04  per  hour  (Ref.  23).  It  should  be  noted  that  the 

F 

fact  that  Bp  >  B^  means  that  the  prefigurance  for  precipitation 
falls  off  with  time  significantly  faster  for  precipitation  than 
for  temperature.  Equation  (E-5)  indicates  that  the  prefigurance 
has  a  value  of  unity  (or  100$  correct)  for  "nowcasting"  at  the 
time  of  forecast  release  (t  =  0).  Similarly,  the  time  (t  )  from 
forecast  release  to  the  climatic  condition  of  no  forecasting 
skill  is  given  by  the  limit  PF1  +  0  in  Eq.  E-5;  for  a  10  percent 
skill  over  climatology,  for  example,  tne  corresponding  t  values 
for  the  above  BT  and  Bp  values  are  115  and  57  hours,  respec¬ 
tively. 

Forecast  verification  data  for  visibility  or  ceiling  indi¬ 
cate  that  Eq.  (E-5)  can  also  apply  to  some  categories  (frequen¬ 
cies)  of  either  event;  i.e.,  in  such  cases,  it  is  possible  to 
describe  accurately  the  visibility  or  ceiling  data  between  3 
and  24  hours  through  the  use  of  appropriate  By  or  Bc  coefficients. 
However,  a  more  general  trend  in  the  data  is  a  deviation  from 
an  exact  exponential  decay.  Nevertheless,  the  AWS  and  TDL  data 
do  show  that  the  prefigurance  for  either  individual  or  added 
categories  of  visibility  (or  ceiling)  is  a  function  of  the  two 
basic  parameters  in  Eq.  E-5,  i.e.,  the  relative  frequency  and 
the  forecast  time.  Hence,  the  prefigurance  for  a  given  type  of 
event  may  be  expressed  in  general  as 

PF ^  =  f(RF1,  t)  .  (E-6 ) 

The  foregoing  correlation  among  prefigurance,  relative  fre¬ 
quency  and  forecast  time  is  as  shown  in  Figs.  E-l  and  E-2  for 
visibility  and  ceiling,  respectively.  These  figures  are  plots 
of  the  data  given  in  Table  E-10  for  the  AWS  verification  data. 
Figure  E-l  shows  the  following:  (1)  the  accuracy  of  station  and 
static  persistence  forecasts  of  visibility  are  comparable  and 
rather  poor  for  parameters  of  tactical  interest.  For  example,  a 
12-hour  forecast  of  visibilities  V  <  3.7  km  is  only  30  percent 
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accurate;  (2)  the  frequency  of  such  visibilities  in  Western 
Europe  is  only  of  the  order  of  5  percent;  (3)  although  not  plot¬ 
ted  on  the  figure,  the  pref igurances  for  visibilities  V  ^  5.6  km 
(Table  E-10)  are  indeed  high  for  forecast  times  as  long  as  24 
hours.  It  is  important  to  note  that  (a)  the  latter  results  are 
given  even  by  persistence  (Eq.  D-2),  and  (b)  they  imply  a  Bv 
<<  g,p.  Figure  E-3  shows  similar  results  for  ceilings,  e.g.,  a 
12-hour  forecast  of  ceilings  C  <  1000  ft  is  only  40  percent 
accurate . 

Figure  E-3  is  a  plot  of  the  TDL  visibility  data  in  Table 
E-ll.  For  the  low  frequency  range  of  interest  for  tactical 
applications  (V  <  4.8  km),  the  basic  points  in  this  figure  are 
as  follows:  (1)  local  forecasts  are  poorer  than  persistence 
for  short-range  forecasts  of  even  6  hours,  and  (2)  guidance 
forecasts  are  also  poorer  than  persistence  for  long-range  fore¬ 
casts,  where  they  are  intended  to  overcome  the  capabilities  of 
local  forecasters;  i.e.,  the  prefigurance  of  a  13-hour  guidance 
forecast  cannot  match  that  of  an  older  (15-hour)  persistence 
forecast . 

SUMMARY  OF  VISIBILITY  AND  CEILING  RESULTS 

Important  results  concerning  both  the  AWS  and  TDL  data  for 
mesoscale  forecasts  of  visibility  and  ceiling  by  persistence, 
local,  and  guidance  forecasts  are  as  follows: 

1.  Local  forecasters  cannot  significantly  improve  on  per¬ 
sistence  forecasts  of  visibility  or  ceiling  in  Western 
Europe  (Tables  E-3  through  E-6).  In  the  contiguous 
United  States,  local  forecasts  are  somewhat  inferior 
to  persistence  forecasts  (Tables  E-8  and  E-9).  These 
results  hold  for  either  individual  (previous  tables) 
or  added  (Tables  E-10,  E-ll)  categories  of  visibility 
or  ceiling. 
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2.  The  forecast  accuracy  for  either  visibility  or  ceiling 
decays  sharply  with  the  decay  of  the  frequency  of  the 
lower  categories  of  visibility  or  ceiling  (Figs.  E-l 
and  E-2 ) ,  The  significance  of  this  result  is  that  the 
forecast  accuracy  of  infrequent  low  visibilities  or  low 
ceilings  ( i.e poor  weather)  constitutes  the  real  test 
of  forecasting  capabilities  for  weather  parameters  of 
tactical  interest , 

3.  The  accuracy  of  persistence  or  local  forecasts  of  visi¬ 
bility  or  ceiling  in  Western  Europe  (Tables  E-3  through 
E-6 )  is  comparable  to  those  in  the  contiguous  United 
States  (Tables  E-8,  E-9).  The  significance  of  this  re¬ 
sult  is  the  fact  that  the  accuracy  of  current  mesoscale 
forecasts  of  visibility  or  ceiling  depends  mainly  on 
the  frequency  or  me so climatology  of  such  events. 

4.  The  accuracy  of  guidance  forecasts  for  infrequent 
events  of  low  visibility  or  ceiling,  as  determined  by 
sophisticated  approaches  of  numerical  weather  predic¬ 
tion  (NWP)  and  model  output  statistics  (MOS)  procedures 
cannot  match  the  performance  of  persistence  forecasts 
for  the  same  type  of  events  (Fig.  E-3).  This  result  is 
not  surprising  in  view  of  the  following  factors:  (1) 
lack  of  a  model  in  the  current  MOS  approach  to  describe 
the  physics  of  mesoscale  visibility  or  ceiling  in  the 
boundary  layer,  and  (2)  the  general  inadequacy  of 
synoptic  (instead  of  mesoscale)  NWF  for  providing  accu¬ 
rate  mesoscale  predictors  of  visibility  or  ceiling. 

It  must  be  emphasized  that  the  foregoing  correlation  between 
forecast  accuracy  and  relative  frequency  of  an  event  is  appli¬ 
cable  to  (a)  individual  or  cumulative  categories  of  visibility 
or  ceiling  and  (b)  each  of  the  three  types  of  forecast:  per¬ 
sistence,  local  or  station,  and  guidance  (Figs.  E-l  to  E-3). 

The  reason  for  this  correlation  is  simply  the  inherent  relative 
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probabilities  for  the  occurrence  of  frequent  and  infrequent 
events  during  the  short,  immediate  future  of  the  forecast  time. 
Thus,  very  frequent  events  (e.g.,  no  precipitation  in  the  Sahara 
desert,  a  sunrise  or  sunset,  etc.)  would  have  a  high  probability 
of  occurrence  on  a  short-range  forecast  of  such  events  by,  say, 
diurnal  persistence;  whereas,  infrequent  events  (e.g.,  heavy 
precipitation  in  the  Sahara  desert,  etc.)  would  have  low  proba¬ 
bilities  of  occurrence  during  the  short,  immediate  future  of  the 
forecast  time. 

Returning  to  the  conceptual  description  of  forecasting 
skills  in  Exhibit  5,  the  foregoing  results  indicate  that  the 
second  and  third  solid  circles  in  that  exhibit  actually  coin¬ 
cide;  i.e.,  today’s  local  and  guidance  forecasting  techniques 
of  visibility  or  ceiling  are  not  significantly  better  than  per¬ 
sistence  for  either  frequent  or  infrequent  events  (e.g.,  Fig. 
E-3). 
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TABLE  E-3.  AWS  Station  Prefigurance  (%)  for  Forecast  of  Visibility 
in  Western  Europe  During  September  1976-March  1977 
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3 

hr 

42 

OJ 

CO 

42 

47 

54 

42 

48 

47 

(0.9SV< 

C 

hr 

31 

24 

30 

■31 

37 

24 

36 

32 

3.7  km) 

12 

hr 

21 

17 

24 

19 

25 

21 

22 

22 

2  4 

hr 

19 

13 

16 

12 

18 

15 

16 

16 

C 

3 

hr 

46 

35 

29 

35 

34 

36 

19 

34 

( 3 • 7*V< 

6 

hr 

25 

20 

16 

16 

21 

25 

19 

2  C 

5.6  km ) 

12 

hr 

14 

16 

13 

16 

12 

1  7 

14 

14 

24 

hr 

10 

13 

13 

12 

11 

14 

12 

12 

D 

3 

hr 

98 

98 

98 

98 

96 

98 

98 

98 

(V^5 . 6  km)  6 

hr 

98 

98 

98 

97 

95 

98 

98 

97 

12 

hr 

98 

97 

96 

96 

94 

96 

97 

96 

24 

hr 

97 

97 

96 

96 

94 

97 

97 

96 

E-18 
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TABLE  E-4 .  A  WS  Persistence  Prefigurance  (%)  for  Forecast  cf  Visi¬ 
bility  in  Western  Europe  During  September  1976-March  1977 


Cate¬ 

gory 

Forecast 

S 

0 

N 

D 

T 

U 

F 

i. 

K 

September- 

March 

A 

3 

hr 

30 

39 

40 

49 

••  52 

32 

42 

43 

(V<0.9  km)  6 

hr 

15 

18 

27 

35 

27 

19 

32 

27 

12 

hr 

0 

2 

18 

19 

13 

5 

18 

13 

24 

hr 

19 

15 

21 

7 

16 

7 

7 

15 

B 

3 

hr 

30 

34 

34 

44 

48 

36 

40 

40 

(0.9*V< 

6 

hr 

33 

25 

26 

28 

32 

25 

27 

28 

3-7  km) 

12 

hr 

19 

8 

15 

15 

19 

15 

12 

16 

26 

hr 

22 

12 

11 

10 

13 

9 

6 

12 

C 

3 

hr 

18 

20 

24 

25 

24 

25 

13 

22 

(3.7*V< 

6 

hr 

11 

18 

13 

10 

14 

15 

11 

13 

5.6  km) 

12 

hr 

7 

9 

7 

7 

10 

12 

7 

8 

24 

hr 

15 

10 

9 

8 

8 

9 

3 

9 

D 

3 

hr 

97 

97 

97 

97 

95 

97 

97 

97 

(V*5 . 6  km)  6 

hr 

96 

96 

96 

95 

92 

96 

97 

95 

12 

hr 

96 

96 

95 

95 

90 

95  . 

96 

95 

24 

hr 

97 

96 

94 

94 

90 

94 

96 

95 

TABLE  E-5 . ' AWS  Station  Prefigurance  (%)  for  Forecast  of  Ceiling 
•  in  Western  Europe  During  September  1576-March  1577 


Cate-  September- 


gory  Fc 

^recast 

S 

0 

N 

D 

J 

F 

M 

March 

A 

3 

hr 

27 

39 

40 

56 

43 

43 

37 

42 

(C<200  ft] 

i  6 

hr 

11 

19 

28 

35 

25 

15 

17 

24 

12 

hr 

.  15 

7 

12 

t 

18 

20 

0 

2 

14 

24 

hr 

7 

3 

3 

1 

10 

2 

.  5 

5 

B 

3 

hr 

59 

68 

66 

73 

75 

64 

68 

69 

(200sC< 

6 

hr 

35 

55 

49 

55 

60 

48 

51 

52 

1000  ft) 

12 

hr 

21 

36 

39 

40 

44 

33 

41 

38 

24 

hr 

18 

24 

27 

24 

31 

22 

24 

26 

C 

3 

hr 

61 

66 

72 

66 

72 

68 

68 

68 

(1000*C< 

6 

hr 

44 

51 

57 

55 

56 

51 

55 

53 

3000  ft) 

12 

hr 

29 

3^ 

38 

35 

34 

34 

37 

35 

24 

hr 

19 

26 

28 

25 

26 

28 

28 

26 

D 

3 

hr 

97 

97 

97 

97 

95 

97 

97 

97 

(0*3000 

6 

hr 

96 

96 

96 

95 

93 

96 

96 

96 

ft) 

12 

hr 

96 

95 

94 

94 

91 

95 

94 

94 

24 

hr 

95 

95 

94 

94 

90 

94 

93 

94 

TABLE  E-6.  A WS  Persistence  Prefigurance  (%)  for  Forecasts  of  Ceil¬ 
ing  in  Western  Europe  During  September  1576-March  1577 


Cate¬ 

gory 

Forecast 

S 

0 

N 

D 

T 

F 

M 

September- 

March 

A 

* 

hr 

23 

42 

33 

37 

45 

24 

33 

36 

(C<200  ft)  6 

hr 

22 

19 

20 

21 

25 

10 

17 

21 

12 

hr 

4 

3 

7 

16 

8 

0 

7 

8 

24 

hr 

13 

6 

13 

10 

12 

0 

.6 

10 

B 

3 

hr 

46 

58 

63 

62 

66 

52 

61 

60 

(200sC< 

6 

hr 

30 

47 

50 

48 

52 

38 

46 

46 

loco  ft)  12 

hr 

13 

27 

38 

33 

36 

26 

28 

31 

2  4 

hr 

16 

20 

28 

18 

25 

14 

19 

21 

C 

3 

hr 

40 

47 

53 

48 

51 

46 

46 

48 

( 1000  sC< 

6 

hr 

28 

34 

42 

36 

36 

32 

33 

35 

3000  ft)  12 

hr 

20 

25 

32 

25 

25 

23 

23 

25 

24 

hr 

16 

18 

23 

17 

20 

15 

16 

13 

D 

3 

hr 

55 

95 

96 

95 

94 

95 

9  a 

95 

(0^3000 

6 

hr 

93 

93 

94 

93 

39 

93 

92 

93 

ft) 

12 

hr 

92 

91 

92 

91 

86 

92 

90 

51 

2a 

hr 

92 

89 

89 

88 

82 

90 

88 

88 

TABLE  E-7.  AWS  Prefigurance  (?)  vg  Frequency  (?)  for  Station  Forecasts  of  Visi 
bility  &  Ceiling  in  Western  Europe  During  September  1976-March  1977 


TABLE  E-8. 


TDL  Prefigurance  (%)  for  Forecasts  of  Visibility 
in  the  Contiguous  United  Stated  During  October 
1975-March  1976  for  Persistence,  Local,  and  Guidance 
Forecasts 


Category 

Forecast 

Persistence 

Local 

Guidance 

1 

3  hr 

47 

34 

— 

(V<0 . 8  km) 

6  hr 

37 

23 

-- 

7  hr 

— 

— 

19 

12  hr 

26 

4 

— 

13  hr 

— 

— 

4. 

15  hr 

20 

-- 

— 

19  hr 

-- 

— 

0 

2 

3  hr 

19 

18 

_  _ 

(0 . 8^V<1 . 6  km) 

6  hr 

8 

6 

— 

7  hr 

— 

— 

8 

12  hr 

5 

3 

— 

13  hr 

— 

— 

4 

15  hr 

6 

— 

-- 

19  hr 

— 

— 

0 

3 

3  hr 

31 

23 

— 

(1.6sV<1.6  km) 

6  hr 

18 

12 

— 

7  hr 

— 

— 

22 

12  hr 

13 

11 

-- 

13  hr 

-- 

— 

15 

15  hr 

12 

— 

-- 

19  hr 

— 

— 

4 

4 

3  hr 

28 

37 

_ 

( 4 . 8zV<8  km) 

6  hr 

16 

22 

-- 

7  hr 

— 

-- 

13 

12  hr 

16 

20 

— 

13  hr 

— 

-- 

13 

15  hr 

13 

— 

-- 

19  hr 

— 

15 

5 

3  hr 

97 

94 

— 

(V^8  km) 

6  hr 

95 

95 

— 

7  hr 

— 

— 

95 

12  hr 

91 

96 

— 

13  hr 

— 

— 

97 

15  hr 

91 

— 

— 

19  hr 

— 

— 

98 

E-23 


•  TABLE  E-9. 


TDL  Prefigurance  (%)  for  Forecasts  of  Ceiling  in 
the  Contiguous  United  States  during  October  1975- 
March  1976  for  Persistence,  Local,  and  Guidance 
Forecasts 


Category 

Forecast 

Persistence 

Local 

Guidance 

1  - 

3  hr 

45 

32 

_ 

( C< 200  ft) 

6  hr 

28 

18 

— 

7  hr 

— 

— 

18 

12  hr 

21 

2 

— 

13  hr 

— 

— 

0 

15  hr 

15 

— 

-- 

* 

19  hr 

— 

— 

0 

.-2 

(200 £C <500  ft) 

3  hr 

44 

38 

— 

6  hr 

26 

19 

— 

7  hr 

-- 

— 

25 

12  hr 

21 

11 

— 

13  hr 

— 

— 

8 

15  hr 

17 

— 

— 

19  hr 

— 

— 

3 

3 

3  hr 

42 

34 

_ _ 

(5 00*C<1000  ft) 

6  hr 

25 

22 

— 

7  hr 

— 

— 

22 

12  hr 

17 

15 

— 

13  hr 

— 

— 

16 

15  hr 

17 

— 

— 

19  hr 

— 

— 

11 

4 

3  hr 

44 

45 

_ _ 

( 1000 £C <2000  ft 

6  hr 

28 

32 

— 

7  hr 

— 

— 

28 

12  hr 

20 

26 

— 

13  hr 

— 

— 

2  . 

15  hr 

18 

— 

— 

19  hr 

— 

— 

18 

5 

3  hr 

95 

94 

—  __ 

(02000  ft) 

6  hr 

93 

94 

— 

7  hr 

— 

— 

94 

12  hr 

89 

95 

— 

13  hr 

— 

— 

94 

15  hr 

87 

— 

— 

19  hr 

— 

— 

97 

E-24 


ctf 

u 

Ch 

h 

tn 

u 

*4 

o 

a> 

t* 

x: 

x: 

x: 

x: 

x: 

x: 

x: 

x; 

x: 

x: 

x: 

x: 

x; 

x: 

JS 

X2 

m 

VO 

rvj 

^r 

m 

VO 

rvj 

-=r 

m 

VO 

rvj 

-=r 

on 

VO 

rvj 

^r 

o 

rH 

CVJ 

rH 

rvj 

rH 

CVJ 

rH 
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TABLE  E-ll.  TDL  Prefigurance  (%)  and  Relative  Frequencies  for  Forecast  of  Visibility 
and  Ceiling  in  Contiguous  United  States  During  October  1975-March  1976 


STATION  (SUBJECTIVE) 
PERSISTENCE  (STATIC) 


FIGURE  E-2.  AWS  Prefigurance  for  Added  Categories  of  Ceiling 
as  a  Function  of  Relative  Frequency  and  Forecast 
Time  (hours). 


PERSISTENCE  (STATIC) 
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APPENDIX  F 

PROJECTING  FORECAST  RELIABILITY  FOR  1985 
INTRODUCTION 

Previous  appendices  have  described  the  mesoscale  weather 
forecasting  methodologies  involving  persistence,  local  or  sta¬ 
tion,  and  guidance  techniques  (Appendix  D)  as  well  as  their 
relative  current  accuracies  or  pref igurances  for  forecasts  of, 
say,  visibility  and  celling  (Appendix  E) .  These  results  may 
be  summarized  as  follows: 

1.  The  accuracy  or  prefigurance  of  mesoscale  weather  fore¬ 
casting  for  visibility  or  ceiling  is  a  function  of  both 
forecast  time  (hours)  and  the  frequency  (i.e.,  number 
of  events  per  period  of  time)  of  the  forecast  event 
(e.g..  Figs.  E-l  to  E-3). 

2.  High  accuracies  or  pref i gurances  are  obtained  for  fore¬ 
cast  events  of  high  frequency  for  any  of  the  three 
available  techniques  for  mesoscale  weather  forecasting: 
i.e.,  persistence,  local  or  station,  and  guidance 
(e.g..  Category  5>  Tables  E-8 ,  E-9).  Furthermore,  the 
decay  in  prefigurance  with  forecast  time  between  3  and 
24  hours  Is  small  for  high  frequency  events  (e.g.. 
Category  D,  Tables  E-3  to  E-6 ) . 

3.  Low  accuracies  or  pref igurances  are  obtained  for  fore¬ 
cast  events  of  low  frequency  for  any  of  the  three  avail 
able  forecasting  techniques.  Furthermore,  NWS  persist¬ 
ence  forecasts  for  low  frequency  events  give  higher  pre 
f igurances  than  either  local  or  guidance  forecasts. 


Improvements  in  forecast  accuracies  for  infrequent  weather 
events  by  either  persistence  or  subjective  techniques  cannot,  of 
course,  be  foreseen.  Therefore,  any  potential  improvement  of 
mesoscale  pref igurances  for  low  frequency  events  must  come  from 
objective  or  guidance  forecasting,  which  is  based  on  numerical 
weather  prediction  (NWP)  and  model  output  statistics  (MOS)  as 
described  in  Appendix  D.  Therefore,  a  main  objective  of  this 
appendix  is  to  project  the  potential  gain  in  the  prefigurance  of 
guidance  forecasts  for  low  frequency  events  in  the  near-term 
future  (circa,  1985). 

CONSTRAINT  IN  PROJECTION  OF  FORECAST  ACCURACY  IMPROVEMENTS 

An  Important  consideration  in  Army  panels'  examination  of 
the  potential  gains  in  tactical  utility  from  1985  improvements 
in  mesoscale  weather  forecasting  of  infrequent  events  (Exhibit  5) 
is  the  need  to  avoid  understatements  of  near-term  improvements 
in  such  forecasting  skills.  For  this  reason,  these  improvements 
must  be  based  on  upper  bound  or  very  optimistic  1985  prefigur- 
ances,  which  may  not  necessarily  reflect  expected  values  in  the 
near-term  future. 

The  upper-bound  improvement  for  the  prefigurance  of  1985 
mesoscale  guidance  forecasts  of  infrequent  events  must  then  be 
based  on  two  considerations:  (1)  the  gains  in  prefigurance 
achieved  by  synoptic  NWP  over  persistence  during  the  past  three 
decades,  and  (2)  the  decoupling  of  NWP  from  MOS  due  to  the  rela¬ 
tively  underdeveloped  state  of  the  latter  for  forecasts  of  low 
visibilities  or  ceilings  (Appendix  E)  .  The  required  upper  bound 
can  thus  be  obtained  by  postulating  that  1985  improvements  in 
the  current  accuracy  of  mesoscale  guidance  forecasts  of  infre¬ 
quent  events  over  persistence  will  be  comparable  to  the  Improve¬ 
ments  achieved  by  synoptic  NWP  over  persistence  during  the  last 
three  decades  for  weather  parameters  that  do  not  require  the  MOS 
approach.  This  procedure  yields  an  upper  bound  because  of  the 
following  implied  optimistic  assumptions: 


1.  The  current  (underdeveloped)  understanding  of  mesoscale 
atmospheric  phenomena  controlling  infrequent  weather 
events  is  comparable  to  the  (well-developed)  understand¬ 
ing  of  synoptic  scale  phenomena  for  frequent  events 
which  already  existed  three  decades  ago.* 

2.  An  adequate  mesoscale  network  of  meteorological  obser¬ 
vations  will  be  developed  in  the  next  decade. 

It  becomes  important  to  emphasize  the  difference  between 
two  types  of  weather  variables:  (1)  those  predicted  directly 
from  the  equations  of  atmospheric  motion  or  NWP  alone,  such  as 
the  height  of  a  given  pressure  level  (e.g.,  the  500  mb),  tem¬ 
perature,  winds,  and  humidity;  and  (2)  those  predicted  with  the 
aid  of  statistical  empirical  correlations  (i.e.,  NWP  plus  MOS) 
such  as  visibility.  Weather  forecast  verification  data  Indicate 
that,  at  the  present  time,  the  latter  guidance  procedure  cannot 
even  match  the  accuracy  of  persistence  forecasts  of  low  frequency 
events  (e.g.,  Fig.  F,-3j  Appendix  E).  Hence,  using  past  improve¬ 
ments  of  a  direct  forecast  variable  (e.g.,  the  height  of  the  500- 
mb  pressure  level)  to  project  improvements  of  an  indirect  fore¬ 
cast  variable  (i.e.,  visibility)  leads  to  upper-bound  considera¬ 
tion  for  the  latter  variable. 

The  considerations  leading  to  an  upper -bound  projection  of 
near-term  mesoscale  forecasting  skills  for  infrequent  events 
must  therefore  include:  (a)  a  brief  review  of  the  past  develop¬ 
ment  of  synoptic  NWP  during  the  last  three  decades,  (b)  the  max¬ 
imum  improvements  of  synoptic  NWP  over  persistence  as  derived 
from  forecast  verification  data  for  parameters  that  do  not  re¬ 
quire  MOS,  such  as  the  height  of  a  given  pressure  level;  and 
(c)  the  basic  developments  that  would  support  a  potential  sig¬ 
nificant  improvement  of  future  mesoscale  NWP  (MNWP). 


* 


D.  Baumhefner,  NCAR. 


PAST  DEVELOPMENT  OF  SYNOPTIC  NUMERICAL  WEATHER  PREDICTION 


The  methodology  of  NWP  Involves  two  steps:  (a)  definition 
of  the  prevailing  state  of  the  atmosphere,  and  (b)  subsequent 
calculations  of  future  weather  patterns.  The  first  step  re¬ 
quires  upper-air  observations  of  the  prevailing  large-scale  or 
synoptic  weather  systems,  a  task  that  is  accomplished  through  an 
upper-air  network  of  radiosonde  balloons.  The  second  step  in¬ 
volves  the  use  of  NWP,  which  utilizes  the  deterministic  equa¬ 
tions  of  motion  of  the  atmosphere.  These  equations,  known  as 
the  primitive  equations  (PE),  must  first  be  integrated  numeri¬ 
cally  with  respect  to  time  over  a  global  or  hemispherical  space 
domain.  The  space  domain  can  next  be  reduced  to  that  of  North 
America,  for  example,  in  order  to  increase  the  resolution  of 
future  synoptic  weather  events  from  a  numerical  grid  size  of 
about  380  km  for  the  hemispherical  domain  to  about  190  km  for 
the  North  American  domain  (Refs.  16,  17,  24).  The  latter  domain 
utilizes  a  limited  area  fine  mesh  (LAFM)  atmospheric  model, 
which  is  nested  in  the  hemispheric  model.  Since  the  development 
of  future  nested  mesoscale  NWP  models  would  be  a  direct  exten¬ 
sion  of  the  present  methodology,  it  becomes  of  interest  to  re¬ 
view  briefly  the  development  of  NWP  over  the  last  few  decades. 

The  genesis  of  NWP  started  about  half  a  century  ago  with  a 
numerical  experiment  that  attempted  to  utilize  the  complete  set 
of  hydro-thermodynamic  equations  for  weather  prediction  by  the 
method  of  finite  differences  (Ref.  25).  This  first  experiment 
was  doomed  to  failure  because  of  the  following  factors:  (a) 
computational  instability  arising  from  the  arbitrary  choice  of 
finite  increments  in  space  and  time,  (b)  compensation  among 
terms  in  the  complete  equations  of  motion,  (c)  insufficient 
accuracy  in  the  knowledge  of  the  initial  state  of  the  atmosphere 
from  the  lack  of  reliable  upper-air  observations,  and  (d)  lack 
of  computers  to  produce  timely  forecasts  ahead  of  the  future 
weather.  Most  of  these  problems  were  dealt  with  in  subsequent 
decades  by: 
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1.  Development  of  a  criterion  for  the  relative  sizes  of 

■ 

the  finite  increments  in  time  and  space  for  avoiding 
.computational  instability,  • 

2.  Simplification  of  the  conservation  equations  of  the 
atmosphere  by  considering  only  macroscale  motions  (Ref.. 
26).  This  approach  yielded  the  so-called  barotropic 
model,  which  is  the  simplest  possible  model  to  describe 
synoptic  motions. 

3.  Rapid  increase  of  upper-air  radiosonde  stations  subse¬ 
quent  to  World  War  II. 

Development  of  five  successive  generations  of  elec¬ 
tronic  computers  with  ever  increasing  computational 
speed  during  the  last  quarter  century.  Using  the  speed 
of  the  IBM  360-91  computer  of  the  late  1960s  as  a  ref¬ 
erence,  these  generations  may  be  identified  successively 
as  follows  (Ref.  27):  (a)  IBM  701  with  a  relative  speed 

of  3  x  10~J,  (b)  IBM  704  with  a  relative  speed  of  10”2, 
(c)  CDC  6600  with  a  relative  speed  of  0.5,  (d)  CDC  7600 
with  a  relative  speed  of  2  as  well  as  the  IBM  360/195 
with  a  relative  speed  of  about  3,  and  (e)  more  recent 
computers  such  as  the  Cray  with  a  relative  speed  of 
about  10.  The  computer  speed  has  thus  increased  by 
more  than  three  orders  of  magnitude  in  the  last  25 
years . 

The  foregoing  developments  made  possible  a  demonstration 
in  1950  of  the  feasibility  of  NWP,  when  the  first  numerical 
forecast  from  real  initial  data  was  computed  with  a  barotropic 
model.  The  present  operational  capabilities  of  NWP  at  the 
National  Weather  Service  (NWS),  for  example,  may  be  characterized 
by  the  following  factors: 

1.  Use  of  upper-air  observational  data,  taken  only  twice  a 
day  from  a  network  of  radiosonde  stations  over  North 
America  and  Europe,  a  network  that  is  characterized  by 


a  geographical  resolution  of  about  300  km.  The  cover¬ 
age  of  this  network  remains  rather  limited,  since  there 
is  lack  of  observational  data  over  a  large  fraction  of 
the  northern  atmosphere  over  the  Pacific  and  Atlantic 
Oceans  as  well  as  over  continents  such  as  Asia.  Remote 
soundings  of  infrared  radiation  from  meteorological  sat¬ 
ellites  have  not  been  able  to  close  this  enormous  gap  in 
observations  (Ref.  28).  However,  the  impact  of  the  sat¬ 
ellite  data  (when  available)  on  the  accuracy  of  mesoscale 
weather  forecasts  has  so  far  been  negligible  (Ref.  28). 

2.  Use  of  fourth-generation  electronic  computers  in  the 
operation  of  the  northern  hemispheric  and  limited  area 
fine  mesh  (LAFM)  models.  The  hemispherical  model  was 
first  run  in  1966,  whereas  the  LAFM  did  so  in  September 
1971  for  only  a  2^-hour  forecast  and  using  steady-state 
instead  of  transient  boundary  conditions  at  the  inter¬ 
face  between  the  LAFM  and  hemispherical  model  (Ref.  29). 

The  NWP  outputs  are  limited  to  synoptic  fields  at  six  pres¬ 
sure  (or  height)  levels  of  the  atmosphere  for  parameters  such  as 
the  heights  of  pressure  levels  (or  geopotentials),  temperature, 
moisture,  etc.  The  MOS  approach  is  then  used  in  order  to  close 
the  gaps  between  (1)  numerical  and  real  weather  parameters  such 
as  visibility,  and  (2)  the  meso-a  (200  <  d  £  2000  km)  and  both 
the  meso-B  (20  <  d  s  200  km)  as  well  as  meso~y  (2  ^  d  s  20  km) 
scales  (Appendix  C).  As  described  in  the  previous  appendices, 
the  MOS  approach  attempts  to  establish  correlations  between  the 
statistics  of  past  NWP  predictions  and  the  corresponding  observed 
weather.  Such  empirical  approach  attempts  to  make  up  for  the 
lack  of  physical  models  for  phenomena  involving  low  visibilities, 
i.e.,  the  MOS  approach  hopes  to  build  in  such  correlations  the 
mesoscale  climatic  statistics  for  even  low  frequency  events. 

Thus,  the  MOS  approach  yields  competitive  results  with  persist¬ 
ence  for  high  frequency  events  with  well-defined  statistics,  but 
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fails  to  do  so  for  the  low  frequency  events  of  Interest.  Ex¬ 
perience  to  date  with  predictants  such  as  low  visibilities  and 
low  ceilings  indicates  very  low  correlations  between  predictors 
and  predictants.* 

PAST  IMPROVEMENTS  OF  SYNOPTIC  NWP  OVER  PERSISTENCE 

As  Indicated  earlier,  the  decay  in  prefigurance  with  in¬ 
creasing  forecast  time  becomes  large  for  low  frequency  events 
(e.g..  Figs.  E-l ,  E-2 ) .  This  decay  of  prefigurance  comes,  in 
general,  from  three  types  of  forecast  errors: 

1.  The  initial  error  in  the  observations  due  to  the  inade¬ 
quate  hemispherical  coverage  of  the  network  of  radio¬ 
sonde  stations. 

2.  The  inherent  degree  of  unpredictability  of  the  atmo¬ 
spheric  motions  (Ref.  30).  This  error  represents  the 
growth  with  time  of  the  initial  error  as  a  consequence 
of  the  unstable  character  of  the  atmospheric  motions. 
Physically,  this  inherent  error  stems  from  the  fact 
that  the  atmospheric  motions  do  not  reproduce  themselves 
periodically  at  a  given  geographical  location  and  during 
the  same  point  of  successive  annual  cycles  (e.g.,  week 
or  month).  Mathematically,  this  inherent  error  stems 
from  the  divergent  nature  of  numerical  solutions  when 
they  start  from  slightly  different  starting  conditions 
due  to  a  small  initial  error.  The  magnitude  of  this 

-  '  inherent  error  has  been  established  from  the  weather 

record  itself  by  attempting  to  detect  two  nearly  iden¬ 
tical  atmospheric  conditions  and  observing  their  subse¬ 
quent  departures. 

3.  The  error  introduced  by  the  NWP  models  on  weather  vari¬ 
ables  that  are  decoupled  from  MOS,  i.e.,  such  as  the 
height  of  the  500-mbar  pressure  level. 

* 

Col.  K.F.  Hebenstreit,  Technique  Development  Laboratory,  Gramax 
Building,  8060  13th  Street,  Silver  Spring,  Maryland  20910. 


A  crude  budget  of  the  relative  contribution  of  the  forego¬ 
ing  errors  can  be  based  on  the  following  approximate  differential 
equation  for  error  growth  (Ref.  31): 

~  =  aE  +  S  ,  (F-D 

where  E  denotes  the  mean  square  error  of  a  given  variable,  a  the 
error  from  the  unstable  character  of  atmospheric  motions,  S  the 
error  source  rate  arising  from  NWP  model  imperfections,  and  t 
the  time.  The  value  of  the  inherent  error  has  been  established 
to  be  a  =  0.55  per  day  (Ref.  30).  Integration  of  the  above 
equation  yields  for  the  final  error  growth  the  expression 

Ef(t)  =  2Eq  +  (Eq  +  S/a)(eat  -  D  ,  (F  2' 

where  E  is  the  initial  error  due  to  the  limited  scope  of  the 
o 

network  of  radiosonde  stations.  The  factor  of  2  comes  about 
from  the  need  to  reuse  observations  in  the  verification  of  a 
forecast.  Equation  F-2  indicates  that  perfect  forecasting  (i.e., 
zero  error  growth  or  a  prefigurance  of  100  percent  at  any  fore¬ 
cast  time)  would  require  both  errorless  analysis  and  interpola¬ 
tions  of  the  observations  (i.e.,  E  =  0)  and  perfect  modeling 
(S  =  0). 

Equation  F-2  can  be  applied  to  the  observed  error  growth  in 
both  persistence  and  NWP  forecasts  of  the  height  of  the  500-mbar 
pressure  level  utilizing  a  =  0.55  per  day.  Since  the  error 
growth  is  linear  with  respect  to  the  parameter  (ea^  -  1)  as 
shown  by  Eq.  F-2,  a  plot  of  the  error  growth,  Ef(t),  for  per- 

(v  4* 

sistence  and  NWP  forecast  against  e  -  1  yields  a  straight  line 
with  different  slope  for  each  type  of  forecast.  The  intercept 
of  either  line  at  e  -1=0  yields  the  magnitude  of  E  ,  where¬ 
as  the  slope  of  each  line  gives  the  value  of  S  corresponding  to 
persistence  and  NWP.  Utilizing  Eq.  F-2  with  these  experimentally 
determined  values  of  the  parameters  EQ  and  S,  Table  F-l  shows 
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results  of  the  error  growth  for  the  height  of  the  average  500- 
mbar  pressure  level  as  a  function  of  forecast  time  (hours). 

TABLE  F-l .  Forecast  RMS  Error  (m)  of  the  500-mbar 

Height  Field  for  Several  Types  of  Forecasts 


Forecast 

Type 

E 

0 

(m2) 

S 

(m2/day ) 

0 

Forecast  Ti 

(hr) 

- 3  5 

12 

24 

Persistence 

200 

3000 

14.1 

28.3 

35.1 

46.8 

67.4 

NWP 

200 

800 

14.1 

22.8 

25.4 

30.4 

40.2 

Perfect  Model 

200 

0 

14.1 

20.4 

20.7 

21.5 

23.4 

Perfect  Ob¬ 
servations 

0 

800 

0 

7.5 

14.6 

21.5 

32.7 

Table  F-l  shows  the  following:  (1)  the  initial  rms  error 

in  the  height  of  the  500-mbar  pressure  level  is  equal  to  /200 

or  14.1  m;  (2)  the  source  error  for  persistence  (no  model)  is 
2 

3000  m  per  day;  NWP  using  fourth-generation  electronic  com¬ 
puters  (GISS  model)  with  a  synoptic  numerical  grid  of  400  km 

2 

has  been  able  to  reduce  the  error  source  from  3000  to  800  m 
per  day;  and  (3)  improvements  from  NWP  over  persistence  can  be 
translated  into  extensions  of  forecast  time  for  the  same  rms 
error.  Thus,  either  by  plotting  or  interpolation  of  the  per¬ 
sistence  and  NWP  error  growths  in  Table  F-l,  it  is  found  that 
the  rms  growth  to  28.3  m  for  a  3-hour  persistence  forecast  has 
been  delayed  by  about  6  hours  by  NWP, 

Figure  F-l  shows  a  plot  based  on  Eq.  F-2  for  forecast  times 
as  long  as  five  days  for  persistence,  NWP,  and  perfect  modeling 
(Ref.  32).  The  latter  shows  an  error  growth  that  is  due  to  the 
Eo(eat-l)  term  in  Eq.  F-2,  i.e.,  as  caused  by  the  initial  ob¬ 
servation  error  (Eq)  and  the  unstable  character  of  the  atmo¬ 
spheric  motions  (a).  The  percentages  on  Fig.  F-l  show  (1)  the 
improvement  by  synoptic  NWP  over  persistence  and  (2)  the  remain¬ 
ing  gap  between  current  and  perfect  synoptic  model  skills  for 
the  present  levels  of  the  initial  error.  This  figure  includes 
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also  a  table  that  gives  estimates  by  personnel  of  the  National 
Center  for  Atmospheric  Research  (NCAR)  for  the  probable  causes 
for  the  difference  between  persistence  and  perfect  forecasting 
(Ref.  32):  grid  size  (^5  percent),  analysis  and  interpolations 
of  the  original  observations  (20  percent),  and  physics  of  the 
model  (35  percent). 

The  time  delay  for  the  growth  to  a  given  error  as  given  by 
synoptic  NWP  relative  to  persistence  (i.e.,  Fig.  F-l  or  Table 
F-l)  can  be  extended  to  the  prefigurance  simply  because  the  de¬ 
cay  in  the  prefigurance  (PF)  with  increasing  forecast  time  is 
caused  by  the  corresponding  growth  in  a  dimensionless  error 
(Ep)  such  that 

PF  +  ED  =  1  ,  (F-3) 

i.e.,  the  sum  of  the  prefigurance  (in  fraction  instead  of  per¬ 
cent)  for  a  forecast  of  any  duration  and  a  dimensionless  error 
for  that  duration  must  be  equal  to  unity.  The  dimensionless 
error  can  be  obtained  by  normalizing  the  error  growth  with  its 
final  climatic  value  (Ec),  as  shown,  for  example,  in  Fig.  F-l 
where  Ec  -  130  m.  Thus,  the  dimensionless  error  can  be  chosen 
as  En  =  (E  -  E  )/(En  -  E„)  from  the  conditions  that  at  the  ini- 
tial  time  E  -*■  Eq  and  PF  ■*  1,  whereas  at  long  forecast  times  the 
error  grows  to  its  climatic  value  for  the  given  category  of 
event,  i.e,,  E  +  Ec  or  Ep  +  1  and  PF  -*■  0 .  From  Eq .  F-3  one  gets 

6PF  =  -6Ed  ,  (F-b) 

where  6  denotes  change.  Equation  F-4  indicates  that  the  improve¬ 
ment  in  the  synoptic  NWP  prefigurance  over  persistence  is  equal 
to  the  decrease  in  the  dimensionless  error  growth  for  a  given 
forecast  time.  Hence,  the  past  improvement  by  synoptic  NWP  over 
persistence  of  the  error  growth  in  Table  F-l  can  be  extended  to 
the  prefigurance,  i.e.,  the  persistence  prefigurance  value  for  a 
reference  forecast  time  of  3  hours  would  be  the  same  as  the  NWP 
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a  (NATURAL  VARIANCE) 


DAYS 


CAUSES  OF  ERROR 

% 

RESOLUTION-  (45) 

HORIZONTAL  32 

VERTICAL  13 

DATA  -  (20) 

OBSERVATIONS  15 

INITIALIZATION  5 

PHYSICS-  (35) 

MOUNTAINS  12 

PRECIPITATION  8 

FRICTION  8 

CONVECTION  5 

RADIATION  2 


FIGURE  F-l.  Forecast  RMS  Error  (m)  of  the 

500-mbar  Height  Field  for  Several 
Types  of  Forecasts. 


prefigurance  for  a  forecast  time  extended  by  the  same  time  in¬ 
crement  At  of  6  hours. 

As  indicated  earlier,  the  prefigurance  of  mesoscale  fore¬ 
casts  of  visibility  or  ceiling  is  a  function  of  both  forecast 
time  and  the  frequency  of  the  forecast  event  (e.g.,  Eq.  E-6). 

Per  low  frequencies,  when  the  decay  in  the  prefigurance  is  ex¬ 
ponential  (Eq.  E-5) ,  it  may  be  written  as 

PF  =  e"Bt  (F-5) 

under  the  assumption  that  PF  -*■  1  (or  100  percent)  as  t  -*•  0.  The 
parameter  3  is  a  coefficient  determined  empirically  from  the 
verification  data  for  a  given  category  and  forecast  technique. 

If  Eq.  F-5  denotes  the  prefigurance  for  static  persistence  fore¬ 
casts  of,  say,  the  height  of  the  500-mbar  pressure  level  (Table 
F-l),  the  prefigurance  for  corresponding  NWP  forecast  can  be 
written  as 

(pf)hwf  *  e'U  *  (F-6) 

where  X  <  3.  The  magnitude  of  X  can  then  be  obtained  from  the 
previous  result  for  the  At  increment  for  the  NWF  forecast  time 
under  the  constraint  of  an  error  growth  identical  to  that  for 
the  persistence  forecast  at  an  earlier  reference  time  t^  (^  3 
hours) ,  i.e. , 

{PF(tr  +  At)}Nwp  =  (PF(tr))p  (F-7 ) 

where  the  subscript  p  denotes  persistence.  The  above  results 
then  yield  the  relation 


X 


g 

1  +  At/tr  » 


(F-8) 


which  identifies  the  parameter  At/tr  for  measuring  the  past  gain 
in  the  NWP  prefigurance  over  that  of  persistence.  For  the  data 
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in  Table  F-l  that  show  a  time  increment  of  6  hours  for  a  refer¬ 
ence  forecast  of  3  hours,  At/tr  =  2.  This  result  is,  of  course, 
applicable  to  parameters  such  as  the  height  of  the  500-mbar 
pressure  level.  For  other  parameters  such  as  visibility,  At/tr 
<<  2.  In  fact,  the  guidance  and  persistence  data  in  the  pre¬ 
vious  appendix  (e.g..  Fig.  E-3)  show  that  At  <  0,  i.e.,  the  time 
increment  can  be  negative  as  given  by  the  current  condition  of 
poorer  guidance  pref igurances  relative  to  the  corresponding 
persistence  values. 

POTENTIAL  MODEL  DEVELOPMENT  FOR  FUTURE  MESOSCALE  NWP  (MNWP) 

When  examining  current  trends  in  mesoscale  weather  research 
within  the  civilian  meteorological  community,  it  becomes  impor¬ 
tant  to  observe  that  (1)  these  trends  do  not  put  emphasis  on  the 
weather  variables  ol  usual  tactical  interest  such  as  the  fore¬ 
cast  of  infrequent  events  of  low  visibility  or  ceiling,  and  (2) 
events  of  low  visibility  (V  <  3  km)  and  low  ceiling  (C  <  1000  ft) 
are  controlled  by  phenomena  within  the  planetary  boundary  layer 
(z  s  1  km.  Appendix  C).  Although  phenomena  in  the  free  tropo¬ 
sphere  is  also  of  interest  for  Army  tactical  operations  (e.g., 
winds  up  to  15-km  altitude  for  artillery  fire),  improvements  in 
forecasting  skills  of  low  visibility  or  ceiling  would  need 
greater  emphasis  on  boundary  layer  research.  Most  of  the  civi¬ 
lian  mesoscale  meteorological  research,  to  be  reviewed  briefly 
below,  is  not  focused  on  improving  the  above  variables  of  tac¬ 
tical  interest. 

Figure  F-l  shows  that  present  model  skill  by  synoptic  NWP 
is  closer  to  persistence  than  to  perfect  model  skill.  Further¬ 
more,  the  table  in  the  same  figure  indicates  that  significant 
gains  in  prefigurance  may  be  derived  by  increasing  the  resolu¬ 
tion  of  synoptic  NWP,  i.e.,  by  decreasing  the  size  of  the  numer¬ 
ical  grid  from  the  190  km  of  the  LAFM  model  for,  say,  North 
America.  For  example,  it  has  already  been  shown  that  by  decreas¬ 
ing  the  grid  size  from  that  of  the  hemispherical  380  km)  to 
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the  LAFM  (%  190  km)  to  the  MFM  (or  movable  fine  mesh,  ^  60  km), 
a  48-hour  forecast  from  each  model  moved  a  low  surface  pressure 
pattern  gradually  from  the  predicted  location  at  the  Gulf  of 
Mexico  by  the  hemispherical  model  to  near  its  observed  location 
over  Ohio  by  the  MFM  model  (Refs.  33,  3*0.  Hence,  it  would  in¬ 
deed  be  too  much  to  ask  from  the  crude  MOS  methodology  if  it 
were  expected  to  overcome  significant  errors  in  the  predictors 
derived  from  synoptic  NWP . 

A  potential  improvement  of  guidance  forecasts  for  low  fre¬ 
quency  events  must,  therefore,  follow  the  guidelines  indicated 
in  Fig.  F-l .  This  is  precisely  the  current  trend  in  meso-B  (20  < 
d  £  200  km)  meteorology,  a  trend  that  is  putting  emphasis  in  a 
sharp  reduction  of  the  North  American  domain  of  the  LAFM  model 
(for  example)  to  that  of  a  regional  area  that  would  include  only 
the  East  Coast  of  the  United  States  (Ref.  35).  Before  indicat¬ 
ing  the  current  state  of  the  art  in  meso-B  NWP  (i.e.,  MNWP),  it 
becomes  important  to  describe  its  evolution. 

The  modeling  of  mesoscale  phenomena  is  not  a  new  trend,  as 
indicated  by  the  relevant  work  during  nearly  the  last  two  de¬ 
cades.  The  scope  of  this  early  work  already  includes  topics 
such  as  the  numerical  experiments  of  convection  in  a  model  atmo¬ 
sphere  (Ref.  36),  theoretical  investigations  of  the  sea  breeze 
(Ref,  37 ),  the  numerical  study  of  a  mesohigh  of  26-27  June  1953 
(Ref.  38),  a  numerical  model  of  thermal  convection  in  the  atmo¬ 
sphere  (Ref.  39 )j  the  effects  of  condensation,  evaporation,  and 
rainfall  on  the  development  of  mesoscale  disturbances  (Ref.  *44), 
etc.  More  recent  efforts  in  mesoscale  involve  a  planned  re¬ 
search  project  on  "Severe  Environmental  Storms  and  Mesoscale 
Experiment  (SESAME)."  The  main  emphasis  of  SESAME  is  on  the 
understanding  of  low  frequency  meso-B  phenomena  (Appendix  C  and 
Ref.  41).  The  scope  of  the  program  involves  both  observations, 
data  management,  and  modeling.  The  consideration  of  observa¬ 
tions  include  vertical  soundings  from  satellites,  severe  storm 
and  tornado  data,  etc.  The  scope  of  data  management  involves 
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planning,  coordinating,  and  monitoring  functions  so  as  to  insure 
the  timely  collection  of  scientific  data.  The  modeling  effort  is 
as  described  below. 

A  brief  survey  of  the  modeling  of  meso-g  phenomena  is  given 
in  Refs.  10  and  42.  Fundamentally,  this  type  of  modeling  repre¬ 
sents  a  somewhat  straightforward  application  of  the  same  primi¬ 
tive  equations  as  in  the  case  of  the  synoptic  NWP.  However,  be¬ 
cause  of  the  higher  numerical  resolution  of  mesoscale  NWP,  it 
becomes  necessary  to  include  phenomena  such  as  the  planetary 
boundary  layer  and  to  reexamine  the  subgrid  parameterlzations  in 
the  primitive  equations  for  the  synoptic  NWP,  More  specifically, 
meso-g  modeling  requires  an  accurate  three-dimensional  represen¬ 
tation  of  the  parameterization  of  boundary  layer  processes.  The 
recommended  techniques  for  use  in  meso-g  modeling  include  the 
development  of  a  three-dimensional  hydrostatic  model  or.  a  fixed 
grid,  with  horizontal  resolutions  greater  than  the  meso-g  observ¬ 
ing  network,  and  with  sufficient  vertical  resolution  to  accurately 
resolve  the  boundary  layer  as  well  as  the  free  atmosphere.  Fur¬ 
thermore,  the  meso-g  equations  must  be  integrated  using  an  effi¬ 
cient  mass  and  energy  conservative  finite  difference  scheme  in 
which  the  lateral  boundary  conditions  are  determined  from  a 
larger  scale  model  or  from  actual  observations.  The  effects  of 
cumulus  activity  on  the  meso-g  scale  may  need  to  be  parameterized 
using  meso-Y  scale  cumulus-field  models. 

A  representative,  near  operational  mesoscale  NWP  model  is 
that  developed  at  Drexel  University  (Ref.  35).  The  size  of  the 
numerical  grid  is  about  35  km  within  a  domain  of  about  1500  km, 
a  domain  that  is  necessary  to  produce  a  24-hour  forecast  at  a 
given  meteorological  station.  Sample  forecasts  have  been  pro¬ 
duced  for  the  Eastern  United  States.  The  computer  facilities  so 
far  utilized  at  the  National  Center  for  Atmospheric  Research 
(NCAR)  corresponds  to  the  fourth-generation  computer  (CDC  7600). 
Near-term  future  work  on  the  development  of  meso-g  NWP  may  be 
further  stimulated  by  the  faster  Cray  computer,  which  is  just 
becoming  operational  at  NCAR. 
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UPPER-BOUND  PROJECTIONS  FOR  NEAR-TERM  MESOSCALE  FORECASTING 
SKILLS 


Previous  considerations  have  established  the  following: 

(1)  projections  for  improvements  in  the  accuracy  of  forecasting 
skills  for  infrequent,  events  must  come  from  guidance  or  scien¬ 
tific  forecasting  techniques,  (2)  the  results  in  Table  F-l  indi¬ 
cate  that  the  maximum  improvement  by  synoptic  NWP  over  persist¬ 
ence  for  frequent  events  during  the  last  three  decades  can  be 
characterized  by  At/tp  =  2,  and  (3)  the  accuracy  for  1977  guid¬ 
ance  forecasts  of  infrequent  events  of  visibility  is  given  by 
At/t^  <  0,  i.e,  ,  the  negative  values  of  At  indicate  that  the 
accuracy  of  the  1977  guidance  pref igurances  cannot  even  match 
those  of  persistence. 

An  upper-bound  projection  for  the  1985  pref igurances  of 
guidance  forecasts  of  infrequent  events  of  visibility  or  ceil¬ 
ing  can  be  obtained  by  using  Eqs .  F-5  to  F-8  with  At/tp  =  6/3  = 
2.  Considering  first  the  simpler  case  of  an  exponential  decay 
in  prefigurance  (i.e.,  Eq.  F-5),  the  corresponding  1985  projec¬ 
tion  is  then  given  by  Eqs.  F-6  and  F-8  together  with  0  param¬ 
eters  obtained  from  current  persistence  forecasts  for  such 
phenomena.  The  upper-bound  pref igurances  are  thus  derived  by 
assuming  that  the  potential  gain  in  mesoscale  NWP  (MNWP)  pre- 
f igurances  for  low  frequency  events  of  visibility  or  ceiling 
would  be  the  same  as  that  achieved  by  synoptic  NWP  over  persist¬ 
ence  during  the  past  few  decades  for  continuous  (i.e.,  maximum 
frequency )  events  such  as  the  height  of  the  500-mbar  pressure 
level.  The  implied  modeling  assumptions  in  this  procedure  are 
that  MNWP  would  always  provide  accurate  predictors  for  the  MOS 
approach,  and  that  the  MOS  approach  would  be  based  on  a  boundary 
layer  model  for  identifying  the  main  MNWP  predictors  for  infre¬ 
quent  events. 

The  foregoing  procedure  (Eqs,  F-6  and  F-8)  would  apply  for 
exponential  decays  in  both  the  persistence  and  1985  MNWP  pre- 
figurances  with  an  increasing  forecast  time  up  to  at  least  3  and 
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9  hours,  respectively.  Verification  data  for  low  frequency 
events  of  visibility  and  ceiling  indicate  that  such  decay  in  the 
persistence  prefigurance  is  not  always  a  strict  exponential.  In 
these  cases,  the  upper-bound  projection  for  the  1985  MNWP  pre- 
figurances  is  established  by  using  (1)  the  3-hour  persistence 
prefigurance  at  9  hours  for  the  1985  MNWP  prediction  (i.e.,  by 
assuming  that  the  MNWP  forecast  would  delay  the  error  growth  in 
the  3-hour  persistence  forecast  by  6  hours,  as  indicated  by  Eq. 

F-7 ) ,  and  (2)  the  same  approximate  shape  of  the  nonexponential 
delay  of  the  persistence  prefigurance  up  to  9  hours.  Between  9 
and  2k  hours,  the  rate  of  prefigurance  decay  was  made  to  tend  to 
that  of  frequent  events,  in  accordance  with  the  constraint  of 
obtaining  an  upper-bound  improvement  in  future  forecasting  skills 
for  the  subsequent  tactical  consideration  by  Army  panels  of  such 
improvements.  This  procedure  is  illustrated  in  Fig.  F-2 ,  which 
was  applied  to  both  low  and  high  frequency  events,  even  though 
the  latter  cases  are  forecast  rather  accurately  even  by  persist¬ 
ence  (Tables  E-10,  E-ll). 

The  results  in  Appendix  E  indicate  that  the  1977  prefigur- 
ances  of  guidance  forecasts  of  infrequent  events  of  visibility 
could  not  match  those  of  persistence.  The  TDI.  verification  data 
(Table  E-ll)  give  a  At/t^  of  about  -1.5/3  or  -0.5.  Therefore, 
the  attainment  of  the  1985  At-/tr  parameter  of  6/3  or  2.0  may  be 
very  difficult  to  achieve  by  MNWP.  If  the  1985  upper-bound  pro¬ 
jection  had  been  found  to  be  of  tactical  interest,  the  second 
phase  of  this  task  (Appendix  A)  would  have  had  to  determine  an 
expected  instead  of  an  upper-bound  projection  of  the  1985  MNWP 
pref lgurances . 

REVIEW  AND  TEST  OF  THE  UPPER-BOUND  PROJECTION 

The  foregoing  methodology  for  an  upper-bound  projection  of 
near-term,  future  forecasting  skills  for  visibility  and  ceiling 
was  reviewed  by  personnel  from  the  following  organizations:  Air 
Weather  Service  (AWS)  of  the  U.S.  Air  Force;  Technique  Development 
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Near-Term  Projection  of  Pref igurances  for  Infrequent 
Events  Based  on  a  Potential  Development  of  Mesoscale 
Numerical  Weather  Prediction  (MNWP). 


Laboratory  (TDL)  of  the  National  Weather  Service  (NWS),  NOAA; 
National  Center  for  Atmospheric  Research  (NCAR),  and  the  School 
of  Meteorology  of  the  Pennsylvania  State  University.  There  was 
a  unanimous  consensus  that  the  use  of  a  9-hour  forecast  by  fu¬ 
ture  MNWP  with  a  3-hour  persistence  prefigurance  (i.e.,  At/tr  = 

2)  was  indeed  very  optimistic. 

A  test  of  the  optimistic  nature  of  the  foregoing  projection 
can  be  obtained  from  recent  verification  of  MNWP  forecasts  for 
winds  aloft  for  a  6-hour  period  (Ref.  43).  Figure  F-3  shows  a 
comparison  of  the  root  mean  square  vector  errors  (rmsve)  in 
meters  per  second  between  persistence  (top  line)  and  several 
mesoscale  models.  It  was  found  that  the  mesoscale  model  yield¬ 
ing  the  smallest  rmsve  (lowest  line)  is  based  on  the  most  physics, 
which  included  advection,  nongeostrophic  acceleration,  vertical 
mixing,  and  friction.  The  geographical  domain  for  these  results 
v/as  nearly  centered  over  the  Nevada  test  site  and  included  an 
area  of  333  x  333  km  with  a  grid  size  of  37  km.  The  main  points 
of  Interest  here  are  that  (1)  the  At/tp  parameter  for  this  meso¬ 
scale  experiment  (Fig.  F-3)  is  equal  to  about  1.5/3  or  0.5,  i.e., 
MNWP  has  yielded  a  positive  time  increment  for  the  forecast  of 
mesoscale  wind  vectors;  and  (2)  the  At/t^  of  0.5  in  this  numeri¬ 
cal  experiment  is  lower  by  a  factor  of  4  than  that  used  for  the 
upper-bound  projections. 

SUMMARY  OF  RESULTS  FOR  PRESENT  AND  PROJECTED  FORECASTING  SKILLS 

Exhibit  16  shows  a  summary  of  the  current  (1977)  and  near- 
term  (1985)  projections  of  mesoscale  weather  forecasting  capa¬ 
bilities  for  several  categories  of  visibility,  ceiling,  precipi¬ 
tation,  and  winds <  The  1977  pref igurances  are  as  given  by  TDL, 
NMC,  and  AWS  data  (Appendix  G),  and  the  1985  values  as  obtained 
by  the  upper-bound  projection  procedure  described  in  this  appen¬ 
dix.  The  data  for  visibility  and  ceiling  in  Exhibit  16  are 
based  on  TDL  (instead  of  AWS)  data  because  of  their  finer  break¬ 
down  for  the  categories  of  visibility  and  ceiling.  In  order  to 
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present  a  perhaps  more  meaningful  set  of  data  to  Army  tactical 
commanders,  the  TDL  categories  have  been  aggregated  using  the 
procedure  illustrated  in  Table  G-46  (Appendix  G). 

It  is  important  to  emphasize  that  the  reviewing  organiza¬ 
tion  identified  above  examined  both  the  methodology  for  the 
near-term  upper-bound  projection  and  the  numerical  results  shown 

in  Exhibit  16 . 
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FORECAST  VERIFICATION  DATA 


INTRODUCTION 

Previous  appendices  have  considered  the  basic  character¬ 
istics  of  mesoscale  weather  phenomena  (Appendix  C),  the  three 
available  mesoscale  weather  forecasting  techniques  (Appendix  D), 
and  the  forecast  verification  methodology  (Appendix  E) .  The 
latter  considerations  included  the  identification  of  the  fore¬ 
cast  verification  parameters  and  the  relative  accuracies  of  the 
three  available  forecasting  techniques. 

As  described  in  Appendix  C,  the  space  dimensions  (d) 
of  interest  for  tactical  considerations  of  weather  are  the  so- 
called  meso-B  (20  s  d  £  200  km)  and  meso-y  (2  £  d  £  20  km) 
mesoscale  subregimes.  Because  of  the  small  magnitude  of  these 
space  scales,  verification  data  for  mesoscale  weather  forecasts 
are  limited  to  a  24-hour  forecast  time. 

Appendix  D  described  the  three  available  forecasting  tech¬ 
niques,  which  are:  persistence,  subjective  (station  or  local) 
and  objective  (guidance).  The  first  type  of  forecast  is  based 
on  the  tendency  of  current  weather  to  continue  to  persist  in 
the  near  future  of  the  forecast  time.  The  second  type  is 
the  product  released  by  a  human  forecaster  at  a  particular 
meteorological  station.  The  third  one  is  the  product  of  cen¬ 
tralized  stations  that  utilize  a  deterministic  forecasting 
approach  based  on  the  use  of  the  dynamics  equations  of  the 
atmosphere  together  with  statistical  approaches. 

The  basic  forecast  verification  parameters  were  described 
in  Appendix  E.  The  most  important  ones  are  the  prefigurance 
(Hi/Oi),  bias  (F^^/0^  )  and  relative  frequency  (C^/EC^);  where 
Hi  denotes  the  number  of  correct  forecasts  (hits)  in  a  given 
category  i  of  weather  event,  0i  the  number  of  occurrences  or 
observations  of  such  events,  the  number  of  forecasts  for  a 


given  event,  and  £0^  the  total  number  of  occurrences  or  obser¬ 
vations  in  the  statistical  sample  of  forecast  verification. 

These  verification  parameters  can  thus  be  determined  from  con¬ 
tingency  tables  (e.g.,  Table  E-l),  which  are  the  product  of 
the  statistical  procedure  of  forecast  verification.  The  con¬ 
tingency  tables  for  a  given  type  of  event  (e.g.,  visibility) 
are  thus  determined  as  a  function  of  the  time  of  the  year  (month, 
season)  and  forecast  time  (hours)  for  each  type  of  forecasting 
technique:  persistence,  local  or  station,  and  guidance. 

The  basic  results  of  forecast  verification  have  also  been 
presented  in  Appendix  E  (i.e..  Figs.  E-l  to  E-3).  These  results 
indicate  the  following:  (1)  the  prefigurance  or  forecast  accu¬ 
racy  is  a  function  of  relative  frequency  and  forecast  time, 

(2)  the  prefigurance  deteriorates  rather  drastically  for  low 
frequency  events  of  tactical  interest  (e.g.,  low  visibilities 
V  <  3  km  and  low  ceilings  C  <  1000  ft)  regardless  of  fore¬ 
casting  technique,  and  (3)  the  prefigurance  from  persistence  is 
surprisingly  better  than  that  of  the  subjective  (man's)  or 
objective  (science)  forecasting  techniques  for  infrequent 
weather  events. 

The  main  objective  of  this  appendix  is  therefore  to  provide 
the  contingency  tables  that  support  the  foregoing  forecast 
verification  results  in  Appendix  E.  These  contingency  tables 
are  important  because  they  determine  the  verification  parameters 
for  every  category  of  weather  event  (C^),  including,  of  course, 
the  often  neglected  relative  frequency  of  the  forecast  event. 


FORECAST  VERIFICATION  PROCEDURES 

The  main  sources  of  forecast  verification  data  were  the 
USAF  Air  Weather  Service  (AWS)#  as  well  as  the  Technique 
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M/Sgt.  Schutte,  Air  Weather  Service,  Scott  Air  Force  Base, 
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Development  Laboratory  (TDL)#  and  the  National  Meteorological 
Center  (NMC)##  of  the  National  Weather  Service  (NWS),  NOAA . 

An  Important  objective  in  forecast  verification  at  the  Air 
Weather  Service  and  National  Weather  Service  is  to  obtain  valid 
statistical  evaluations  of  mesoscale  forecasting  skills,  both 
for  their  own  evaluation  and  further  future  development  of  such 
skills . 

The  statistical  evaluation  of  mesoscale  forecasting  skills 
is  obtained  through  verification  of  a  large  sample  of  weather 
forecasts.  The  available  AWS  verification  data  for  Western 
Europe,  for  example,  considered  over  half  a  million  forecasts 
for  visibility  or  ceiling  of  different  forecast  duration.  The 
statistical  evaluation  of  forecasting  skills  involves  verifi¬ 
cation  of  operational  forecasts  issued  at  suitable  meteorological 
stations  within  a  large  geographical  domain  and  during  prolonged 
periods  of  time.  The  geographical  domain  of  the  AWS  data  in¬ 
cludes  35  stations  in  Western  Europe  distributed  as  follows: 

17  in  Germany,  15  in  England,  2  in  Spain,  and  1  in  Northern 
Italy.  The  time  domain  for  the  AWS  verification  data  included 
the  months  between  September  1976  and  March  1977.  Likewise, 

TDL  data  for  visibility  or  ceiling  are  based  on  a  sample  of  over 
a  hundred  thousand  forecasts  of  several  hours  duration.  The 
geographical  domain  of  the  TDL  data  includes  92  stations  within 
the  contiguous  United  States  distributed  across  every  major 
section  of  the  country  (i.e..  Northeast,  Southeast,  Northwest, 
Southwest,  and  the  North  and  South  central  states).  The  time 
domain  of  the  TDL  data  includes  the  months  between  October  1975 
to  March  1976. 

_  t 

Col.  K.F.  Hebenstreit,  TDL,  Gramax  Building,  Silver  Spring, 

Maryland  20910. 

**David  Olson,  NMC  (World  Weather  Building),  NWS,  NOAA, 

Washington,  D.C. 


At  the  selected  meteorological  stations,  forecast  veri¬ 
fications  are  made  of  each  operational  forecast,  which  are 
issued  daily  at  a  rate  that  depends  on  the  local  weather.  The 
normal  rate  is  of  two  forecasts  each  day,  which  can  be  expanded 
to  more  frequent  forecasts  during  bad  weather.  At  each  selected 
station,  the  resident  meteorologist  continues  to  issue  opera¬ 
tional  local  forecasts,  which  are  based  on  several  factors: 

(a)  local  surface  observations  made  hourly,  (b)  synoptic  weather 
charts  released  from  central  to  local  stations  through  auto¬ 
mated  communication  channels,  (c)  guidance  forecasts  for  the 
particular  station  as  released  from  central  stations,  (d)  meso- 
climatology  for  his  particular  station,  and  (e)  meteorological 
insight  from  his  own  professional  training  and  experience.  It 
should  be  noted  that  persistence  forecasts  do  not  have  to  be 
formally  issued,  because  they  are  imbedded  in  the  hourly  ob¬ 
servational  record.  Persistence  forecasts  can  always  be  made 
after  the  fact,  by  merely  looking  up  in  the  record  of  the 
observed  weather  the  conditions  that  prevailed  at  the  time  of 
the  local  or  guidance  forecast  release.  Since  persistence  has 
no  model  skill  to  forecast  changes  of  weather,  it  becomes  a 
readily  available  absolute  reference  for  establishing  the  rela¬ 
tive  skills  of  the  local  or  guidance  forecasts. 

The  forecast  verification  procedure  is  straightforward  and 
part  of  the  permanent  meteorological  record.  Forecasts  issued 
at  the  verification  stations  are  labeled  permanently  and  they 
are  verified  against  the  record  of  hourly  surface  observations, 
which  are  gathered  by  nonforecasters  at  the  particular  station. 

The  quality  of  a  statistical  set  of  forecast  verification 
data  may  be  assessed  through  the  following:  (1)  determination 
of  the  degree  of  correlation  of  the  pref igurances  (1^/C^)  as  a 
function  of  the  relative  frequency  (0^/10^)  for  a  given  forecast 
time  (e.g..  Figs.  E-l  to  E-3),  and  (2)  relative  comparisons  of 
forecasting  skills  as  derived  from  at  least  two  independent  but 
compatible  sets  of  statistics  (e.g.,  AWS  for  Western  Europe  and 


TDL  for  the  contiguous  United  States).  The  compatibility  con¬ 
dition  for  the  forecast  verification  requires  only  that  the  two 
independent  sets  of  verification  data  include  equivalent  ranges 
of  the  relative  frequency  of  weather  events. 


VERIFICATION  DATA  FOR  VISIBILITY  AND  CEILING 

The  AWS  and  TDL  forecast  verification  for  visibility  or 
ceiling  are  applicable  to  the  so-called  categoric  (yes/no)  or 
nonprobabilistic  forecasts  with  an  implied  100  percent  proba¬ 
bility  for  the  occurrence  of  the  forecast  event  (Appendix  D) . 
For  the  AWS  data,  the  contingency  tables  for  either  visibility 
or  ceiling  are  given  as  a  function  of  the  following:  (1)  fore¬ 
cast  technique,  which  can  be  either  persistence  or  station, 

(2)  forecast  time  for  3,  6,  12,  and  24  hours,  and  (3)  month 
of  verification  from  September  1976  to  March  1977.  The  AWS 
contingency  tables  for  visibility  and  ceiling  considered  the 
following  categories: 


Visibility 

Category  (V,  nm) 


Ceiling 
(C,  ft) 


A 

B 

C 

D 


V  <  0.5 
0.5  *  V  <  2.0 

2  *  V  <  3 

V  *  3 


C  <  200 

200  ^  C  <  1000 
1000  *  C  <  3000 
C  3000 


For  the  TDL  data,  the  contingency  tables  for  either  visi¬ 
bility  or  ceiling  are  given  as  a  function  of  the  following: 

(1)  forecast  technique,  which  includes  persistence,  local, 
and  guidance;  (2)  forecast  time  for  3,  6,  9,  12,  and  15  hours 
for  persistence,  3,  6,  and  12  hours  for  local,  and  7,  13,  and 
19  hours  for  guidance.  These  odd  hours  for  the  forecast  time 
in  the  guidance  forecasts  come  about  by  the  characteristics  of 
the  forecasting  cycle  as  illustrated  in  Fig.  G-l.  This  figure 
indicates  the  following:  (1)  upper  air  observations  are  taken 
at  00Z  for  the  first  half  of  the  daily  forecasting  cycle  (and 
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at  12Z  for  the  second  half);  (2)  the  NWP  synoptic  charts  to  48 
hours  become  available  at  03Z;  (3)  guidance  forecasts  are  re¬ 
leased  at  05Z;  (4)  local  forecasts  are  released  at  the  appro¬ 
priate  local  time  (09Z)  based  on  (a)  local  surface  observations 
up  to  09Z,  (b)  the  synoptic  charts  which  became  available  at 
"03Z,*and  (c)  the  guidance  forecasts  released  at  05Z;  and  (5) 
the  verification  procedure  is  based  on  the  hourly  local  obser¬ 
vations  at  12Z,  15Z,  18Z,  21Z,  and  24Z.  Hence,  a  complete  set 
of  the  corresponding  local  (and  persistence)  forecasts  at  veri¬ 
fication  time  would  be  3,  6,  9,  12,  and  15  hours,  while  those 
for  guidance  (and  persistence)  would  be  7,  10,  13,  16,  and  19 
hours.  The  available  TDL  verification  data  for  local  .and  guid¬ 
ance  forecasts  are  then  the  incomplete  sets  indicated  above, 
i.e.,  (a)  3,  6,  and  12  hours  for  the  local  and  (b)  7,  13,  and 
19  hours  for  the  guidance  forecasts.  The  TDL  contingency  tables 
for  visibility  and  ceiling  considered  the  following  categories: 


Category 

Visibility 
(V,  st.  mi.) 

Ceiling 
(C,  ft) 

1 

< 

A 

O 

vjn 

C  <  200 

2 

0.5  <  v  <  1 

200  <  C  <  500 

3 

1  *  V  <  3 

500  ^  C  <  1000 

4 

3  *  V  <  5 

1000  <  C  <  2000 

5 

V  ;>  5 

C  ^  2000 

For  the  AWS  monthly  contingency  tables,  they  can  be  added 
to  obtain  a  contingency  table  for  the  whole  period.  Furthermore, 
the  AWS  and  TDL  data  for  the  specified  categories  of  visibility 
•and  ceiling  can  also  be  added  to  obtain  contingency  tables  for 
new  categories  such  as  A,  A  +  B,  A  +  B  +  C ,  and  D  for  the  AWS 
data,  and  1,  1+2,  1+2+3,  1+2+3+^,  and  5  for  the 
TDL  data.  The  result  of  this  latter  procedure  is  contingency 
tables  for  cumulative  pref igurances  and  relative  frequencies 
as  shown  in  Figs.  E-l  to  E-3 • 
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ORGANIZATION  OF  DATA  FOR  VISIBILITY  AND  CEILING 

As  indicated  earlier,  the  main  results  from  the  AWS  and  TDL 
verification  data  for  visibility  or  ceiling  are  presented  in 
Appendix  E  (Tables  E-3  to  E-ll,  and  Figs.  E-l  to  E-3).  In 
addition  to  the  summary  data  in  Appendix  E,  this  section  in¬ 
cludes  the  contingency  tables  that  become  important  for  the 
calculation  of  any  other  desired  verification  parameter. 

The  AWS  data  were  available  in  the  form  of  computer  print¬ 
outs  instead  of  a  formal  report,  because  the  validation  data 
for  either  visibility  or  ceiling  alone  are  of  very  recent  origin 
The  AWS  data  are  given  in  Tables  G-l  through  G-37  of  this  appen¬ 
dix.  These  tables  provide  the  following: 

Tables  G-l  and  G-2.  Summary  of  AWS  prefigurance  data  for 
visibility  for  station  and  static  persistence  forecasts,  respec¬ 
tively.  The  results  in  these  tables  are  based  on  the  subsequent 
contingency  Tables  G-6,  G-7,  and  G-10  to  G-23.  Tables  G-l  and 
G-2  show  prefigurance  data,  in  percent,  for  each  month  and  the 
whole  period.  A  comparison  of  Tables  G-l  and  G-2  shows  that 
there  is  very  little  improvement  in  the  prefigurance  obtained 
by  local  forecasters  over  that  of  persistence. 

Tables  G-S  and  G-4.  Summary  of  AWS  prefigurance  data  for 
ceiling  for  station  e,nd  static  persistence  forecasts,  respec¬ 
tively.  The  results  in  these  tables  are  based  on  the  subsequent 
summary  contingency  Tables  G-8,  G-9»  and  G-2 A  to  G-37.  The 
data  in  Tables  C--3  and  G-k  show  again  that  for  ceiling  there 
is  no  significant  improvement  in  the  prefigurance  obtained  by 
man  over  that  of  persistence  forecasts. 

Table  G-5.  Illustration  of  the  AWS  relative  frequency  for 
each  category  of  visibility  and  ceiling  for  local  forecasts. 

The  results  in  these  tables  are  based  on  the  contingency  Tables 
G-6  and  G-8.  Table  G-5  shows  a  rather  low  frequency  for  the 
first  three  categories  of  either  visibility  or  ceiling,  and  very 
high  frequencies  for  only  high  frequency  events  of  clear  weather 
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Tables  G-6  to  G-9.  Summary  of  AWS  contingency  tables  for 
station  and  persistence  forecasts  of  visibility  (Tables  G-6 
and  G-7)  and  ceiling  (Tables  G-8  and  G-9)  Tables  G-6  through 
G-9  were  obtained  by  direct  addition  of  the  subsequent  monthly 
contingency  Tables  G-10  to  G-37.  These  contingency  tables  show 
the  bias  for  each  category  for  eigher  visibility  or  ceiling. 
Tables  G-10  through  G-37  were  taken  from  AWS  printout  data,  and 
they  are  as  follows: 

Tables  G-10  to  G-16.  Monthly  AWS  contingency  tables  for 
station  forecasts  of  visibility .  Each  table  contains  data  for 
several  forecast  durations. 

Tables  G-17  to  G-23.  Monthly  AWS  contingency  tables  for 
persistence  forecasts  of  visibility . 

Tables  G-24  to  G-30.  Monthly  AWS  contingency  tables  for 
station  forecasts  of  ceiling. 

Tables  G-31  to  G-37.  Monthly  AWS  contingency  tables  for 
persistence  forecasts  of  ceiling. 

The  TDL  data,  like  the  AWS  data,  were  available  in  the  form 
of  computer  printouts  instead  of  a  formal  report,  because  the 
validation  data  for  either  visibility  or  ceiling  alone  at  TDL 
are  also  of  very  recent  origin.  The  TDL  data  are  given  in 
Tables  G-38  through  G-^5-  These  tables  provide  the  following. 

Tables  G-38  and  G-39.  Summary  of  TDL  prefigurance  data 
for  visibility  and  ceiling,  respectively,  for  static  persistence, 
local,  and  guidance  forecasts.  The  results  in  these  tables  are 
based  on  the  subsequent  contingency  Tables  G-40  to  G-45.  The 
results  in  Tables  G-38  and  G-39  indicate  that  the  prefigurance 
values  for  persistence  are  best.  As  indicated  earlier,  the 
local  data  are  limited  to  3,  6,  and  12  hours,  whereas  the  guid¬ 
ance  data  are  so  for  7,  13,  and  19  hours. 

Tables  G-40  to  G-42.  TDL  contingency  tables  for  visibility 
for  static  persistence,  local,  and  guidance  forecasts. 
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Tables  G-43  to  G-4S.  TDL  contingency  tables  for  ceiling 
for  static  persistence,  local,  and  guidance  forecasts. 

Tables  G-46  to  G-48.  Tables  for  added  categories  of  visi¬ 
bility  and  ceiling  for  both  AWS  and  TDL  data.  Table  G-46  illus¬ 
trates  the  procedure  used  to  determine  the  prefigurance  for 
category  given  by  addition(s)  of  individual  categories,  i.e., 
to  convert  prefigurance  data  from  the  A,  B,  C,  and  D  categories 
to  A,  A+B,  A+B+C,  and  D  for  the  AWS  data,  and  from  1,  2, 

3,  4,  and  5  to  1,  1+2,  1+2+3,  1+2+3+4,  and  5  for 
the  TDL  data.  Tables  G-47  and  G-48  provide  a  summary  of  the 
prefigurance  data  for  these  modified  categories  for  the  AWS  and 
TDL  data,  respectively.  These  tables  indicate  again  that  per¬ 
sistence  is  very  difficult  to  improve  on  by  either  local  or 
guidance  forecasts. 

VERIFICATION  DATA  FOR  PRECIPITATION 

Large  rates  of  precipitation  could  change  the  trafficabil- 
ity  of  the  battlefield.  For  this  reason,  it  becomes  of  interest 
to  obtain  the  so-called  quantitative  precipitation  forecasts 
(q.p.f.)  of  average  precipitation  amount  within  specified  future 
time  intervals.  It  is  important  to  indicate  that  Army  engineers 
would  have  the  task  to  convert  q.p.f.  forecasts  into  traffica- 
bility  templets  for  armor  and  other  military  branches .  However , 
the  methodology  for  this  conversion  has  not  been  validated  and , 
therefore ,  has  not  been  put  into  operational  use  (Ref.  44). 

Contingency  tables  for  q.p.f.  were  unavailable  either  at 
the  AWS  or  TDL.  Some  prefigurance  and  post-agreement  data  were 
available  only  at  the  National  Meteorological  Center  (NMC)*  and, 
then,  only  for  q.p.f.  The  NMC  q.p.f.  data  provided  prefigurance 
and  post-agreement  values  for  forecast  intervals  of  one  and  two 


* 
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days  for  daily  average  amounts  of  precipitation  greater  than 
either  0.5  or  1.0  inch.  These  data  did  not  include  prefigurance 
or  post-agreement  data  for  forecasts  of  no  precipitation.  How¬ 
ever,  this  latter  type  of  precipitation  data  was  available  at 
the  AWS  in  the  form  of  contingency  table  for  conditions  such 
as  no  precipitation,  freezing  precipitation,  etc.  The  precip¬ 
itation  data  used  in  this  study  are,  therefore,  based  on  the 
combination  of  NMC  data  for  q.p.f.  and  AWS  data  for  no  precip¬ 
itation.  Table  G-^9  shows  the  NMC  data,  whereas  Table  G-50 
shows  a  sample  of  the  AWS  prefigurance  data.  The  categories 
in  this  table  denote  no  precipitation  (N),  rain  and  liquid  pre¬ 
cipitation  (R),  freezing  precipitation  (Z)  and  frozen  precipi¬ 
tation  (F).  It  should  be  noted  that  the  category  R  of  ; recipi- 
tation  does  not  imply  q.p.f. 

VERIFICATION  DATA  FOR  WINDS 

Verification  data  for  winds  was  available  at  TDL  (Ref.  ^5). 
Prefigurance  data  are  provided  in  Exhibit  16. 
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TABLE  G-l.  AWS  Station  Prefigurance  (%)  for  Forecast  of  Visibility 
in  Western  Europe  During  September  1976-March  1977  * 


Cate¬ 

gory 

Forecast 

S 

0 

N 

D 

J 

F 

M 

September- 

March 

A 

3  hr 

38 

43 

46 

54 

48 

42 

44 

46 

(V<0 . 9  km)  6  hr 

19 

26 

36 

29 

33 

17 

19 

28 

12  hr 

14 

10 

20 

19 

24 

7 

8 

17 

24  hr 

11 

8 

14 

5 

14 

7 

0 

10 

B 

3  hr 

42 

38 

42 

47 

54 

42 

48 

47 

( 0 . 9SV< 

6  hr 

31 

24 

30 

31 

37 

24 

36 

32 

3.7  km) 

12  hr 

21 

17 

24 

19 

25 

21 

22 

22 

24  hr 

19 

13 

16 

12 

18 

15 

16 

16 

C 

3  hr 

46 

35 

29 

35 

34 

36 

19 

34 

( 3  •  7s  V< 

6  hr 

25 

20 

16 

16 

2.1 

25 

19 

20 

5*6  km ) 

12  hr 

14 

16 

13 

16 

12 

17 

14 

14 

24  hr 

10 

13 

13 

12 

11 

14 

12 

12 

D 

3  hr 

98 

98 

98 

98 

96 

98 

98 

98 

(V*5.6  km)  6  hr 

98 

98 

98 

97 

95 

98 

98 

97 

12  hr 

98 

97 

96 

96 

94 

96 

97 

96 

* - 

24  hr 

97 

97 

96 

96 

94 

97 

97 

96 

The  prefigurance  values  in  this  table  are  derived  from  the 
subsequent  summary  contingency  Table  G-6  and  Tables  G-10 
to  G-16. 
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TABLE  G-2.  AWS  Persistence  Prefigurance  (%)  for  Forecast  of 

Visibility  in  Western  Europe  During  September  1976- 
March  1977* 


Cate-  September- 


gory  Forecast 

S 

0 

N 

D 

J 

F 

M 

March 

A 

3 

hr 

30 

39 

40 

49 

52 

32 

42 

43 

(V<0.9  km) 

i  6 

hr 

15 

18 

27 

35 

27 

19 

32 

27 

. 

12 

hr 

0 

2 

18 

19 

13 

5 

18 

13 

24 

hr 

19 

15 

21 

7 

16 

7 

7 

15 

B 

3 

hr 

30 

34 

34 

44 

48 

36 

40 

40 

(0.9*V< 

6 

hr 

33 

25 

26 

28 

32 

25 

27 

28 

3-7  km) 

12 

hr 

19 

8 

15 

15 

19 

15 

12 

16 

24 

hr 

22 

12 

11 

10 

13 

9 

6 

12 

C 

3 

hr 

18 

20 

24 

25 

24 

25 

13 

22 

(3.7*V< 

6 

hr 

11 

18 

13 

10 

14 

15 

11 

13 

5.6  km) 

12 

hr 

7 

9 

7 

7 

10 

12 

7 

8 

24 

hr 

15 

10 

9 

8 

8 

9 

3 

9 

D 

3 

hr 

97 

97 

97 

97 

95 

97 

97 

97 

(V^5 . 6  km) 

i  6 

hr 

96 

96 

96 

95 

92 

96 

97 

95 

12 

hr 

96 

96 

95 

95 

90 

95 

96 

95 

24 

hr 

97 

96 

94 

94 

90 

94 

96 

95 

The  prefigurance  values  in  this  table  are  derived  from  the 
subsequent  summary  contingency  Table  G-7  and  Tables  G-17 
to  G-23 • 
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TABLE  G-3.  AWS  Station  Prefigurance  (%)  for  Forecast  of  Ceiling 
in  Western  Europe  During  September  1976-March  1977* 


Cate-  September- 


gory  Forecast 

S 

0 

N 

D 

J 

F 

M 

March 

A 

3 

hr 

27 

39 

40 

56 

43 

43 

37 

42 

( C<200  ft)  6 

hr 

11 

19 

28 

35 

25 

15 

17 

24 

12 

hr 

15 

7 

12 

18 

20 

0 

2 

14 

24 

hr 

7 

3 

3 

1 

10 

2 

5 

5 

B 

3 

hr 

59 

68 

66 

73 

75 

64 

68 

69 

(20  r*c:< 

6 

hr 

35 

55 

49 

55 

60 

48 

51 

52 

1000  ft) 

12 

hr 

21 

36 

39 

40 

44 

33 

41 

38 

24 

hr 

18 

24 

27 

24 

31 

OJ 

24 

26 

c 

3 

hr 

61 

66 

72 

66 

72 

68 

68 

68 

(1000sC< 

6 

hr 

44 

51 

57 

55 

56 

51 

55 

53 

3000  ft) 

12 

hr 

29 

34 

38 

35 

34 

34 

37 

35 

24 

hr 

19 

26 

28 

25 

26 

28 

28 

26 

D 

3 

hr 

97 

97 

97 

97 

95 

97 

97 

97 

(0*3000 

6 

hr 

96 

96 

96 

95 

93 

96 

96 

96 

ft) 

12 

hr 

96 

95 

94 

94 

91 

95 

94 

94 

24 

hr 

95 

95 

94 

94 

90 

94 

93 

94 

1 — - 

The  prefigurance  values  in  this  table  are  derived  from  the 

subsequent  summary  contingency  Table  G-8  and  Tables  G-24 

to  G-30. 
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TABLE  G-4.  AWS  Persistence  Prefigurance  (%)  for  Forecasts  of 
Ceiling  in  Western  Europe  During  September  1976- 
March  1977* 


Cate¬ 
gory  Forecast 

S 

0 

N 

D 

J 

F 

M 

Septemter- 

March 

A 

3 

hr 

23 

42 

33 

37 

45 

24 

33 

36 

(C<200  ft)  6 

hr 

22 

19 

20 

21 

25 

10 

17 

21 

12 

hr 

4 

3 

7 

16 

8 

0 

7 

8 

24 

hr 

13 

6 

13 

10 

12 

0 

6 

10 

B 

3 

hr 

46 

58 

63 

62 

66 

52 

61 

60 

(200^C< 

6 

hr 

30 

47 

50 

48 

52 

38 

46 

46 

1000  ft) 

12 

hr 

13 

27 

CO 

33 

36 

26 

28 

31 

24 

hr 

16 

20 

28 

18 

25 

14 

19 

21 

C 

3 

hr 

40 

47 

53 

48 

51 

46 

46 

48 

(1000sC< 

6 

hr 

28 

34 

42 

36 

36 

32 

33 

35 

3000  ft) 

12 

hr 

20 

25 

32 

25 

25 

23 

23 

25 

24 

hr 

16 

18 

23 

17 

20 

15 

16 

18 

D 

3 

hr 

95 

95 

96 

95 

94 

95 

94 

95 

(0*3000 

6 

hr 

93 

93 

94 

93 

89 

93 

92 

93 

ft) 

12 

hr 

92 

91 

92 

91 

86 

92 

90 

91 

24 

hr 

92 

89 

89 

88 

82 

90 

88 

88 

The  prefigurance  values  in  this  table  are  derived  from  the 
subsequent  summary  contingency  Table  G-9  and  Tables  G-31 
to  G-37. 
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The  prefigurance  and  frequency  values  in  this  table  are  derived  from  the  subsequent 
summary  contingency  Tables  G-6  and  G-8. 
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TALLE  G-10 .  AWS-V-S-S  (AWS  Validation  Date:  Visibility 
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TABLE  G-ll .  AWS-V-S-0  (AWS  Validation  Data:  Visibility 
Station,  October  1976,  Western  Europe) 
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TABLE  G-13.  AWS-V-S-D  (AWS  Validation  Data:  Visibility 
Station,  December  1976,  Western  Europe) 
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TABLE  G-15.  AWS-V-S-F  (AWS  Validation  Data:  Visibility 
Station,  February  1977,  Western  Europe) 


TABLE  G-17.  AWS-V-P-S  (AWS  Validation  Data:  Visibility, 
Persistence,  September  1976,  Western  Europe) 
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TABLE  G-19.  AWS-V-P-N  (AWS  Validation  Data:  Visibility 
Persistence,  November  1976,  Western  Europe) 


TABLE  G-20 .  AWS-V-P-D  (AWS  Validation  Data:  Visibility 
Persistence,  December  1976,  Western  Europe) 


10,060  1 10 ,857  t  139  uou  274  10 ,429  (11.2^6 


TABLE  G-21.  AWS-V-P-J  (AWS  Validation  Data:  Visibility 
Persistence,  January  1977,  Western  Europe) 


TABLE  G-22.  AWS-V-P-F  (AWS  Validation  Data:  Visibility 
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TABLE  G-23.  AWS-V-P-M  (AWS  Validation  Data:  Visibility 
Persistence,  March  1977,  Western  Europe) 
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TABLE  G-25.  AWS-C-S-0  (AWS  Validation  Data:  Ceiling 


TABLE  G-26.  AWS-C-S-N  (AWS  Validation  Data:  Ceiling 
Station,  November  1976,  Western  Europe) 
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TABLE  G-29.  AWS-C-S-F  (AWS  Validation  Data:  Ceiling 
Station,  February  1977,  Western  Europe) 


TABLE  G-31.  AWS-C-P-S  (AWS  Validation  Data:  Ceiling, 

Persistence,  September  1976,  Western  Europe) 


TABLE  G-32.  AWS-C-P-0  (AWS  Validation  Data:  Ceiling, 
Persistence,  October  1976,  Western  Europe) 
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TABLE  G-3M.  AWS-C-P-D  (AWS  Validation  Data:  Ceiling 


222  514  885  £  c  12  122  152  627 

512  8,360  9,197  §  D  44  453  642  8,398 


TABLE  G-35.  AWS-C-P-J  (AWS  Validation  Data:  Ceiling, 
Persistence,  January  1977,  Western  Europe) 


TABLE  G-36.  AWS-C-P-F  (AWS  Validation  Data:  Ceiling, 

Persistence,  February  1977,  Western  Europe) 


9,887  T  51  426  694  9,060  |10,231 


TABLE  0-37.  AWS-C-P-M  (AWS  Validation  Data:  Celling, 
Persistence,  March  1977,  Western  Europe) 
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TABLE  0-38. 


TDL  Prefigurance  (%)  for  Forecasts  of  Visibility 
in  the  Contiguous  United  Stated  During  October 
1975-March  1976  for  Persistence,  Local,  and  Guidance 
Forecasts* 
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The  prefigurance  values  in  this  table  are  derived  from  the 
subsequent  Tables  G-40  to  G-42. 
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i  TABLE  G-39. 

TDL 

Prefigurance  (X)  for  Forecasts  of 

Ceiling  in 

!  P* 

the 

Contiguous 

United  States 

during  October  1975- 

March  1976  for 

Persistence , 

Local,  and 

Guidance 

Forecasts* 
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The  prefigurance 

values  in 

this  table  are  derived 

from  the 

subsequent 

Tables  G- 

-43  to  G 

-45. 
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TABLE  G-40.  TDL  Validation  Data  for  Persistence  Forecasts  of  Visibility 
in  Contiguous  United  States  During  October  1975-March  1976 


271  189  581  672  13,599  115,312  T  1255  173  5^8  628  12,626  |lH,230 


TABLE  G-l»l.  TDL  Validation  Data  for  Local  Forecasts  of  Visibility 

in  Contiguous  United  States  During  October  1975-March  1976 


381  13,415  13.919 


TABLE  G-43.  TDL  Validation  Data  for  Persistence  Forecasts  of  Ceiling 

in  Contiguous  United  States  During  October  1975-March  1976 


224  468  715  1,041  12,531  I  14,979  T  1 214  440  670  1,000  11,728  Il4,052 


TDL  Validation  Data  for  Guidance  Forecasts  of  Ceiling 
in  Contiguous  United  States  During  October  1975-March  1976 


Occurrences 


TABLE  G-46.  Sample  of  Superimposition  of  Categories  for  3-hr 


Station  Forecasts  of  Visibility  in  Western  Europe 
During  September  1976-March  1977  (Table  G-6) 


3-hr  Forecast 

B  C  D  I  T 


TABLE  G-47.  AWS  Prefigurance  (%)  and  Relative  Frequency  for  Forecast  of  Visibility 
and  Ceiling  in  Western  Europe  During  September  1976-March  1977* 


TABLE  G-48.  TDL  Prefigurance  (%)  and  Relative  Frequencies  for  Forecast  of  Visibility 
and  Ceiling  in  Contiguous  United  States  During  October  1975-March  1976* 
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Prefigurance  and  relative  frequency  values  are  obtained  by  adding  the  categories 
(see  Table  G-46)  in  Tables  G-lJO  to  G-45. 


TABLE  G-49.  NMC  Prefigurance  Data  for  Precipitation  During  1976 
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